Saturday, November 16, 2024
HomeSoftware DevelopmentSD Occasions Open-Supply Undertaking of the Week: Quickwit

SD Occasions Open-Supply Undertaking of the Week: Quickwit

[ad_1]

Quickwit is an open-source search engine on object storage with subsecond latency for big datasets. 

The venture made by the authors of the Rust search engine library tantivy lately raised $2.6 million in a seed spherical co-led by FirstMark and firstminute with many extra contributors. 

Quickwit 0.2 was launched in January with new options reminiscent of the power to ingest Kafka natively with exactly-one semantics, a search stream API, PostgreSQL metastore, tag pruning, and a correct indexing pipeline.

The search engine makes use of a unique strategy than Elasticsearch which depends on doc replication. In the meantime, Quickwit indexes paperwork on a single node and leaves it to an object storage to duplicate the ensuing index information.

“We have to replicate paperwork someplace, to contemplate them ingested,” Paul Masurel, co-founder of Quickwit wrote in a weblog publish. “We make it attainable for customers to plug Quickwit straight into their favourite distributed queue. Proper now Quickwit solely helps Kafka.”

Frequent use circumstances for Quickwit embrace looking by logs, including full-text search capabilities to OLAP databases reminiscent of ClickHouse, and looking by backups that sit on cloud storage by including Quickwit index information in your identical storage.

 

[ad_2]

RELATED ARTICLES

LEAVE A REPLY

Please enter your comment!
Please enter your name here

Most Popular

Recent Comments