Redis, Docker & Raspberry PI

Happy New Year!. Time for the first post of 2020. Have been wanting to write a post on raspberry pi and Redis for some time now. Finally, here it is. I also added docker to the mix of things just to make it interesting. Just to make sure you do need an internet connection. To get all this going I used a Raspberry Pi 3 Model B Quad Core CPU 1.2 GHz 1 GB RAM, so it is about 4 years old hardware. It uses Raspbian Stretch distribution is also an upgrade from Raspbian Jessie. The upgrade is pretty simple though it took a few hours. Below is a Raspberry PI which I used for this blog entry. As you can see it has been well-loved 😉 I have divided the entry into three parts Installing docker on Raspberry PI Run a Redis container on Raspberry PI Redis Operations on … Read more

Spark & Redis

One of the fantastic use-cases of Redis is its use along with Apache-Spark in-memory computation engine. You can in some sense use it as a backend to persist spark objects – data frames, datasets or RDDs in the Redis Cache alongside other cached objects. To enable this there is a very handy library available called Spark-Redis. This library has both Scala and Python-based API. Redis can be used to persist data and be used as a backend – it can be used to share common data between various jobs rather than loading the same data again and again. This makes Redis an invaluable tool for big data developers. In this blog post, we will use both scala and python based API to read data and write data frames and RDDs to/from Redis. Using Scala API In this section, we will read and write to a Redis cluster using Scala and … Read more

Redis – Data Structures – Introduction

Now that you have seen how easy it is to setup Redis. Let’s start our exploration journey. Redis is a data structure server, it means you can store data in various different data structures depending upon your requirements. It supports a number of data structures. Some of them are listed below Simple Strings Lists Sets Sorted sets Hashes Bit Arrays HyperLogLogs Streams To get started quickly on these data structures via the Redis-CLI – I suggest you have a look at this link. It is a very nice read and a quick way to get introduced to Redis data structures via the CLI interface. Personally, I read this to get started as well! Introduces all the data structures- if you just want a quick introduction just read – Redis Strings, Lists, Sets and Hashes. Remaining you can leave them till you need them! In this blog, in addition to looking … Read more

Redis – Getting Started

Redis is an open-source, in-memory, stateless, distributed datastore. It is heavily used as a distributed cache, as a NoSQL for storing data in memory. Redis can also be used as a message broker, for serving fast in-memory analytics. But simply to get started let’s just use Redis as a cache. Redis is not as hard as it looks or may seem. You can be on your way to using it in a very short time. The idea for a Redis mini-series started when I started writing about scaling airflow using Redis. Redis blog entries cover the following aspects Data Structures – Lists, Sets, Maps etc – Using Redis CLI, Python and Scala Using Redis with Apache Spark Configuring Redis Cluster Using AWS Elastic Cache for Redis with AWS EMR Let’s get started! – As is the case with any software we need to download and install it. Well with Redis, … Read more