README.md
1[](https://travis-ci.org/redis/hiredis)
2
3# HIREDIS
4
5Hiredis is a minimalistic C client library for the [Redis](http://redis.io/) database.
6
7It is minimalistic because it just adds minimal support for the protocol, but
8at the same time it uses an high level printf-alike API in order to make it
9much higher level than otherwise suggested by its minimal code base and the
10lack of explicit bindings for every Redis command.
11
12Apart from supporting sending commands and receiving replies, it comes with
13a reply parser that is decoupled from the I/O layer. It
14is a stream parser designed for easy reusability, which can for instance be used
15in higher level language bindings for efficient reply parsing.
16
17Hiredis only supports the binary-safe Redis protocol, so you can use it with any
18Redis version >= 1.2.0.
19
20The library comes with multiple APIs. There is the
21*synchronous API*, the *asynchronous API* and the *reply parsing API*.
22
23## UPGRADING
24
25Version 0.9.0 is a major overhaul of hiredis in every aspect. However, upgrading existing
26code using hiredis should not be a big pain. The key thing to keep in mind when
27upgrading is that hiredis >= 0.9.0 uses a `redisContext*` to keep state, in contrast to
28the stateless 0.0.1 that only has a file descriptor to work with.
29
30## Synchronous API
31
32To consume the synchronous API, there are only a few function calls that need to be introduced:
33
34 redisContext *redisConnect(const char *ip, int port);
35 void *redisCommand(redisContext *c, const char *format, ...);
36 void freeReplyObject(void *reply);
37
38### Connecting
39
40The function `redisConnect` is used to create a so-called `redisContext`. The
41context is where Hiredis holds state for a connection. The `redisContext`
42struct has an integer `err` field that is non-zero when an the connection is in
43an error state. The field `errstr` will contain a string with a description of
44the error. More information on errors can be found in the **Errors** section.
45After trying to connect to Redis using `redisConnect` you should
46check the `err` field to see if establishing the connection was successful:
47
48 redisContext *c = redisConnect("127.0.0.1", 6379);
49 if (c != NULL && c->err) {
50 printf("Error: %s\n", c->errstr);
51 // handle error
52 }
53
54### Sending commands
55
56There are several ways to issue commands to Redis. The first that will be introduced is
57`redisCommand`. This function takes a format similar to printf. In the simplest form,
58it is used like this:
59
60 reply = redisCommand(context, "SET foo bar");
61
62The specifier `%s` interpolates a string in the command, and uses `strlen` to
63determine the length of the string:
64
65 reply = redisCommand(context, "SET foo %s", value);
66
67When you need to pass binary safe strings in a command, the `%b` specifier can be
68used. Together with a pointer to the string, it requires a `size_t` length argument
69of the string:
70
71 reply = redisCommand(context, "SET foo %b", value, (size_t) valuelen);
72
73Internally, Hiredis splits the command in different arguments and will
74convert it to the protocol used to communicate with Redis.
75One or more spaces separates arguments, so you can use the specifiers
76anywhere in an argument:
77
78 reply = redisCommand(context, "SET key:%s %s", myid, value);
79
80### Using replies
81
82The return value of `redisCommand` holds a reply when the command was
83successfully executed. When an error occurs, the return value is `NULL` and
84the `err` field in the context will be set (see section on **Errors**).
85Once an error is returned the context cannot be reused and you should set up
86a new connection.
87
88The standard replies that `redisCommand` are of the type `redisReply`. The
89`type` field in the `redisReply` should be used to test what kind of reply
90was received:
91
92* **`REDIS_REPLY_STATUS`**:
93 * The command replied with a status reply. The status string can be accessed using `reply->str`.
94 The length of this string can be accessed using `reply->len`.
95
96* **`REDIS_REPLY_ERROR`**:
97 * The command replied with an error. The error string can be accessed identical to `REDIS_REPLY_STATUS`.
98
99* **`REDIS_REPLY_INTEGER`**:
100 * The command replied with an integer. The integer value can be accessed using the
101 `reply->integer` field of type `long long`.
102
103* **`REDIS_REPLY_NIL`**:
104 * The command replied with a **nil** object. There is no data to access.
105
106* **`REDIS_REPLY_STRING`**:
107 * A bulk (string) reply. The value of the reply can be accessed using `reply->str`.
108 The length of this string can be accessed using `reply->len`.
109
110* **`REDIS_REPLY_ARRAY`**:
111 * A multi bulk reply. The number of elements in the multi bulk reply is stored in
112 `reply->elements`. Every element in the multi bulk reply is a `redisReply` object as well
113 and can be accessed via `reply->element[..index..]`.
114 Redis may reply with nested arrays but this is fully supported.
115
116Replies should be freed using the `freeReplyObject()` function.
117Note that this function will take care of freeing sub-replies objects
118contained in arrays and nested arrays, so there is no need for the user to
119free the sub replies (it is actually harmful and will corrupt the memory).
120
121**Important:** the current version of hiredis (0.10.0) free's replies when the
122asynchronous API is used. This means you should not call `freeReplyObject` when
123you use this API. The reply is cleaned up by hiredis _after_ the callback
124returns. This behavior will probably change in future releases, so make sure to
125keep an eye on the changelog when upgrading (see issue #39).
126
127### Cleaning up
128
129To disconnect and free the context the following function can be used:
130
131 void redisFree(redisContext *c);
132
133This function immediately closes the socket and then free's the allocations done in
134creating the context.
135
136### Sending commands (cont'd)
137
138Together with `redisCommand`, the function `redisCommandArgv` can be used to issue commands.
139It has the following prototype:
140
141 void *redisCommandArgv(redisContext *c, int argc, const char **argv, const size_t *argvlen);
142
143It takes the number of arguments `argc`, an array of strings `argv` and the lengths of the
144arguments `argvlen`. For convenience, `argvlen` may be set to `NULL` and the function will
145use `strlen(3)` on every argument to determine its length. Obviously, when any of the arguments
146need to be binary safe, the entire array of lengths `argvlen` should be provided.
147
148The return value has the same semantic as `redisCommand`.
149
150### Pipelining
151
152To explain how Hiredis supports pipelining in a blocking connection, there needs to be
153understanding of the internal execution flow.
154
155When any of the functions in the `redisCommand` family is called, Hiredis first formats the
156command according to the Redis protocol. The formatted command is then put in the output buffer
157of the context. This output buffer is dynamic, so it can hold any number of commands.
158After the command is put in the output buffer, `redisGetReply` is called. This function has the
159following two execution paths:
160
1611. The input buffer is non-empty:
162 * Try to parse a single reply from the input buffer and return it
163 * If no reply could be parsed, continue at *2*
1642. The input buffer is empty:
165 * Write the **entire** output buffer to the socket
166 * Read from the socket until a single reply could be parsed
167
168The function `redisGetReply` is exported as part of the Hiredis API and can be used when a reply
169is expected on the socket. To pipeline commands, the only things that needs to be done is
170filling up the output buffer. For this cause, two commands can be used that are identical
171to the `redisCommand` family, apart from not returning a reply:
172
173 void redisAppendCommand(redisContext *c, const char *format, ...);
174 void redisAppendCommandArgv(redisContext *c, int argc, const char **argv, const size_t *argvlen);
175
176After calling either function one or more times, `redisGetReply` can be used to receive the
177subsequent replies. The return value for this function is either `REDIS_OK` or `REDIS_ERR`, where
178the latter means an error occurred while reading a reply. Just as with the other commands,
179the `err` field in the context can be used to find out what the cause of this error is.
180
181The following examples shows a simple pipeline (resulting in only a single call to `write(2)` and
182a single call to `read(2)`):
183
184 redisReply *reply;
185 redisAppendCommand(context,"SET foo bar");
186 redisAppendCommand(context,"GET foo");
187 redisGetReply(context,&reply); // reply for SET
188 freeReplyObject(reply);
189 redisGetReply(context,&reply); // reply for GET
190 freeReplyObject(reply);
191
192This API can also be used to implement a blocking subscriber:
193
194 reply = redisCommand(context,"SUBSCRIBE foo");
195 freeReplyObject(reply);
196 while(redisGetReply(context,&reply) == REDIS_OK) {
197 // consume message
198 freeReplyObject(reply);
199 }
200
201### Errors
202
203When a function call is not successful, depending on the function either `NULL` or `REDIS_ERR` is
204returned. The `err` field inside the context will be non-zero and set to one of the
205following constants:
206
207* **`REDIS_ERR_IO`**:
208 There was an I/O error while creating the connection, trying to write
209 to the socket or read from the socket. If you included `errno.h` in your
210 application, you can use the global `errno` variable to find out what is
211 wrong.
212
213* **`REDIS_ERR_EOF`**:
214 The server closed the connection which resulted in an empty read.
215
216* **`REDIS_ERR_PROTOCOL`**:
217 There was an error while parsing the protocol.
218
219* **`REDIS_ERR_OTHER`**:
220 Any other error. Currently, it is only used when a specified hostname to connect
221 to cannot be resolved.
222
223In every case, the `errstr` field in the context will be set to hold a string representation
224of the error.
225
226## Asynchronous API
227
228Hiredis comes with an asynchronous API that works easily with any event library.
229Examples are bundled that show using Hiredis with [libev](http://software.schmorp.de/pkg/libev.html)
230and [libevent](http://monkey.org/~provos/libevent/).
231
232### Connecting
233
234The function `redisAsyncConnect` can be used to establish a non-blocking connection to
235Redis. It returns a pointer to the newly created `redisAsyncContext` struct. The `err` field
236should be checked after creation to see if there were errors creating the connection.
237Because the connection that will be created is non-blocking, the kernel is not able to
238instantly return if the specified host and port is able to accept a connection.
239
240 redisAsyncContext *c = redisAsyncConnect("127.0.0.1", 6379);
241 if (c->err) {
242 printf("Error: %s\n", c->errstr);
243 // handle error
244 }
245
246The asynchronous context can hold a disconnect callback function that is called when the
247connection is disconnected (either because of an error or per user request). This function should
248have the following prototype:
249
250 void(const redisAsyncContext *c, int status);
251
252On a disconnect, the `status` argument is set to `REDIS_OK` when disconnection was initiated by the
253user, or `REDIS_ERR` when the disconnection was caused by an error. When it is `REDIS_ERR`, the `err`
254field in the context can be accessed to find out the cause of the error.
255
256The context object is always free'd after the disconnect callback fired. When a reconnect is needed,
257the disconnect callback is a good point to do so.
258
259Setting the disconnect callback can only be done once per context. For subsequent calls it will
260return `REDIS_ERR`. The function to set the disconnect callback has the following prototype:
261
262 int redisAsyncSetDisconnectCallback(redisAsyncContext *ac, redisDisconnectCallback *fn);
263
264### Sending commands and their callbacks
265
266In an asynchronous context, commands are automatically pipelined due to the nature of an event loop.
267Therefore, unlike the synchronous API, there is only a single way to send commands.
268Because commands are sent to Redis asynchronously, issuing a command requires a callback function
269that is called when the reply is received. Reply callbacks should have the following prototype:
270
271 void(redisAsyncContext *c, void *reply, void *privdata);
272
273The `privdata` argument can be used to curry arbitrary data to the callback from the point where
274the command is initially queued for execution.
275
276The functions that can be used to issue commands in an asynchronous context are:
277
278 int redisAsyncCommand(
279 redisAsyncContext *ac, redisCallbackFn *fn, void *privdata,
280 const char *format, ...);
281 int redisAsyncCommandArgv(
282 redisAsyncContext *ac, redisCallbackFn *fn, void *privdata,
283 int argc, const char **argv, const size_t *argvlen);
284
285Both functions work like their blocking counterparts. The return value is `REDIS_OK` when the command
286was successfully added to the output buffer and `REDIS_ERR` otherwise. Example: when the connection
287is being disconnected per user-request, no new commands may be added to the output buffer and `REDIS_ERR` is
288returned on calls to the `redisAsyncCommand` family.
289
290If the reply for a command with a `NULL` callback is read, it is immediately free'd. When the callback
291for a command is non-`NULL`, the memory is free'd immediately following the callback: the reply is only
292valid for the duration of the callback.
293
294All pending callbacks are called with a `NULL` reply when the context encountered an error.
295
296### Disconnecting
297
298An asynchronous connection can be terminated using:
299
300 void redisAsyncDisconnect(redisAsyncContext *ac);
301
302When this function is called, the connection is **not** immediately terminated. Instead, new
303commands are no longer accepted and the connection is only terminated when all pending commands
304have been written to the socket, their respective replies have been read and their respective
305callbacks have been executed. After this, the disconnection callback is executed with the
306`REDIS_OK` status and the context object is free'd.
307
308### Hooking it up to event library *X*
309
310There are a few hooks that need to be set on the context object after it is created.
311See the `adapters/` directory for bindings to *libev* and *libevent*.
312
313## Reply parsing API
314
315Hiredis comes with a reply parsing API that makes it easy for writing higher
316level language bindings.
317
318The reply parsing API consists of the following functions:
319
320 redisReader *redisReaderCreate(void);
321 void redisReaderFree(redisReader *reader);
322 int redisReaderFeed(redisReader *reader, const char *buf, size_t len);
323 int redisReaderGetReply(redisReader *reader, void **reply);
324
325The same set of functions are used internally by hiredis when creating a
326normal Redis context, the above API just exposes it to the user for a direct
327usage.
328
329### Usage
330
331The function `redisReaderCreate` creates a `redisReader` structure that holds a
332buffer with unparsed data and state for the protocol parser.
333
334Incoming data -- most likely from a socket -- can be placed in the internal
335buffer of the `redisReader` using `redisReaderFeed`. This function will make a
336copy of the buffer pointed to by `buf` for `len` bytes. This data is parsed
337when `redisReaderGetReply` is called. This function returns an integer status
338and a reply object (as described above) via `void **reply`. The returned status
339can be either `REDIS_OK` or `REDIS_ERR`, where the latter means something went
340wrong (either a protocol error, or an out of memory error).
341
342The parser limits the level of nesting for multi bulk payloads to 7. If the
343multi bulk nesting level is higher than this, the parser returns an error.
344
345### Customizing replies
346
347The function `redisReaderGetReply` creates `redisReply` and makes the function
348argument `reply` point to the created `redisReply` variable. For instance, if
349the response of type `REDIS_REPLY_STATUS` then the `str` field of `redisReply`
350will hold the status as a vanilla C string. However, the functions that are
351responsible for creating instances of the `redisReply` can be customized by
352setting the `fn` field on the `redisReader` struct. This should be done
353immediately after creating the `redisReader`.
354
355For example, [hiredis-rb](https://github.com/pietern/hiredis-rb/blob/master/ext/hiredis_ext/reader.c)
356uses customized reply object functions to create Ruby objects.
357
358### Reader max buffer
359
360Both when using the Reader API directly or when using it indirectly via a
361normal Redis context, the redisReader structure uses a buffer in order to
362accumulate data from the server.
363Usually this buffer is destroyed when it is empty and is larger than 16
364kb in order to avoid wasting memory in unused buffers
365
366However when working with very big payloads destroying the buffer may slow
367down performances considerably, so it is possible to modify the max size of
368an idle buffer changing the value of the `maxbuf` field of the reader structure
369to the desired value. The special value of 0 means that there is no maximum
370value for an idle buffer, so the buffer will never get freed.
371
372For instance if you have a normal Redis context you can set the maximum idle
373buffer to zero (unlimited) just with:
374
375 context->reader->maxbuf = 0;
376
377This should be done only in order to maximize performances when working with
378large payloads. The context should be set back to `REDIS_READER_MAX_BUF` again
379as soon as possible in order to prevent allocation of useless memory.
380
381## AUTHORS
382
383Hiredis was written by Salvatore Sanfilippo (antirez at gmail) and
384Pieter Noordhuis (pcnoordhuis at gmail) and is released under the BSD license.
385