QueuesΒΆ
The queue setup is similar to the one used by the CAA indexer:
The search
exchange is the entry point for new messages. It will route them
to either the search.delete
queue or the search.index
one.
Messages in search.delete
are used to delete documents from the Solr index
without any additional queries by simply calling solr.Solr.delete_many()
with the ids contained in the message.
For messages in search.index
, additional queries have to be made to update
the data.
If processing any message failed, it will be sent to the search.retry
queue, which automatically dead-letters them back to search
after 4 hours
for another try.
If processing a message failed too often, it will be put into search.failed
for manual inspection and intervention.
Note that all messages are processed by default, but it is possible to
optionally focus on processing message for a specified set of entity
types only, through the option --entity-type
.