* . *
  • About
  • Advertise
  • Privacy & Policy
  • Contact
Sunday, June 22, 2025
Earth-News
  • Home
  • Business
  • Entertainment
    Netflix unveils Dallas immersive venue for fans of hit shows like ‘Squid Game,’ ‘Stranger Things’ – Houston Chronicle

    Step Inside Netflix’s New Dallas Immersive Experience Featuring Hits Like ‘Squid Game’ and ‘Stranger Things

    ‘Puttin’ on the Ritz’: Civic Players bring ‘Young Frankenstein’ to life – Yahoo

    Civic Players Deliver a Hilarious and Unforgettable Performance of ‘Young Frankenstein

    ‘Wheel of Fortune’: Amputee Wins $60,000 After Breaking Incredible ‘Curse’ – Hastings Tribune

    Wheel of Fortune’ Amputee Breaks Incredible ‘Curse’ to Win $60,000!

    North Star Sports & Entertainment Network: Coming soon – KTTC News

    North Star Sports & Entertainment Network: Coming soon – KTTC News

    Safety concerns in Deep Ellum create apprehension as the entertainment district gains visitors – CBS News

    Safety Concerns Surge Amid Deep Ellum’s Booming Popularity and Growing Crowds

    Elisabeth Moss’ ‘Handmaid’s Tale’ Emmy chances, by the numbers – Yahoo

    Elisabeth Moss’ ‘Handmaid’s Tale’ Emmy chances, by the numbers – Yahoo

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Tech Champions with Leo Bletnitsky of Healthy Technology Solutions – Buzz Media Group

    Meet Tech Champion Leo Bletnitsky of Healthy Technology Solutions

    Crypto’s true revolution is about humanity, not technology – Cointelegraph

    Crypto’s Real Revolution: Transforming Humanity Beyond Technology

    $1 Billion Problem: New Technology Could Save Your Daily Cup of Coffee – SciTechDaily

    The $1 Billion Challenge: How New Technology Could Rescue Your Daily Cup of Coffee

    Canada’s construction industry gets serious about investing in technology as pressure mounts to do more with less – Yahoo Finance

    Canada’s Construction Industry Accelerates Tech Investments to Overcome Growing Challenges and Boost Efficiency

    Workforce Technology Eases Staffing Shortages in Rural Health Care – AJMC

    Workforce Technology Eases Staffing Shortages in Rural Health Care – AJMC

    Get the lead out: Putting new at-home lead testing technology to the test | Denver7 Investigates – Denver7

    Putting the Latest At-Home Lead Testing Technology to the Ultimate Test

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
  • Home
  • Business
  • Entertainment
    Netflix unveils Dallas immersive venue for fans of hit shows like ‘Squid Game,’ ‘Stranger Things’ – Houston Chronicle

    Step Inside Netflix’s New Dallas Immersive Experience Featuring Hits Like ‘Squid Game’ and ‘Stranger Things

    ‘Puttin’ on the Ritz’: Civic Players bring ‘Young Frankenstein’ to life – Yahoo

    Civic Players Deliver a Hilarious and Unforgettable Performance of ‘Young Frankenstein

    ‘Wheel of Fortune’: Amputee Wins $60,000 After Breaking Incredible ‘Curse’ – Hastings Tribune

    Wheel of Fortune’ Amputee Breaks Incredible ‘Curse’ to Win $60,000!

    North Star Sports & Entertainment Network: Coming soon – KTTC News

    North Star Sports & Entertainment Network: Coming soon – KTTC News

    Safety concerns in Deep Ellum create apprehension as the entertainment district gains visitors – CBS News

    Safety Concerns Surge Amid Deep Ellum’s Booming Popularity and Growing Crowds

    Elisabeth Moss’ ‘Handmaid’s Tale’ Emmy chances, by the numbers – Yahoo

    Elisabeth Moss’ ‘Handmaid’s Tale’ Emmy chances, by the numbers – Yahoo

  • General
  • Health
  • News

    Cracking the Code: Why China’s Economic Challenges Aren’t Shaking Markets, Unlike America’s” – Bloomberg

    Trump’s Narrow Window to Spread the Truth About Harris

    Trump’s Narrow Window to Spread the Truth About Harris

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    Israel-Gaza war live updates: Hamas leader Ismail Haniyeh assassinated in Iran, group says

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    PAP Boss to Niger Delta Youths, Stay Away from the Protest

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Court Restricts Protests In Lagos To Freedom, Peace Park

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Fans React to Jazz Jennings’ Inspiring Weight Loss Journey

    Trending Tags

    • Trump Inauguration
    • United Stated
    • White House
    • Market Stories
    • Election Results
  • Science
  • Sports
  • Technology
    Tech Champions with Leo Bletnitsky of Healthy Technology Solutions – Buzz Media Group

    Meet Tech Champion Leo Bletnitsky of Healthy Technology Solutions

    Crypto’s true revolution is about humanity, not technology – Cointelegraph

    Crypto’s Real Revolution: Transforming Humanity Beyond Technology

    $1 Billion Problem: New Technology Could Save Your Daily Cup of Coffee – SciTechDaily

    The $1 Billion Challenge: How New Technology Could Rescue Your Daily Cup of Coffee

    Canada’s construction industry gets serious about investing in technology as pressure mounts to do more with less – Yahoo Finance

    Canada’s Construction Industry Accelerates Tech Investments to Overcome Growing Challenges and Boost Efficiency

    Workforce Technology Eases Staffing Shortages in Rural Health Care – AJMC

    Workforce Technology Eases Staffing Shortages in Rural Health Care – AJMC

    Get the lead out: Putting new at-home lead testing technology to the test | Denver7 Investigates – Denver7

    Putting the Latest At-Home Lead Testing Technology to the Ultimate Test

    Trending Tags

    • Nintendo Switch
    • CES 2017
    • Playstation 4 Pro
    • Mark Zuckerberg
No Result
View All Result
Earth-News
No Result
View All Result
Home Technology

Benchmarking Postgres Vector Search Approaches: Pgvector vs. Lantern

January 17, 2024
in Technology
Benchmarking Postgres Vector Search Approaches: Pgvector vs. Lantern
Share on FacebookShare on Twitter

An elephant holding a lantern

Vector search in Postgres is a space that has seen very active development in the last few months. While Pgvector is known to most people, a few weeks ago we came across Lantern, which also builds a Postgres-based vector database. So, we thought about benchmarking both to compare the two approaches. In this post, we’ll cover:

Quick background on doing vector search in PostgreSQL.Comparing Pgvector and Lantern in terms of syntax and ease of use.Benchmarks comparing index creation time, size, latency, throughput, and recall.Summary of the results

Intro to Vector Search in PostgreSQL​

One of the reasons for the popularity of Vector Search these days has to do with the emergence of powerful embedding models and their use in AI. You have probably witnessed how many people, startups, and big companies are exploring how to take advantage of vectors and incorporate them into their products.

Such enthusiasm has also attracted the Postgres community. Pgvector arose with the ability to create IVVFlat indexes on existing tables with a simple DDL statement. And so, people were given the ability to easily perform similarity queries.

But Pgvector is not the only one in this space. The community has come up with other alternatives as well. One such example was pg_embedding. In July, Neon published a post where they showed how its extension was 20x faster than Pgvector by using HNSW indexes . However, Pgvector quickly caught up and introduced the HNSW index as well. Around that time, on September 29th, Neon stopped supporting pg_embedding and suggested migrating to Pgvector.

Another Postgres extension in the vector search domain is Lantern, developed by a company of the same name. In October, a post on their blog claimed that their extension could outperform Pgvector by 90x in index creation time. That was an outstanding achievement!

So, I spent some time playing with Lantern, and I’d like to share some of my findings in this blog post. I divided it into two parts: the first one is a quick qualitative comparison, and the second one is a quantitative comparison using a popular benchmark.

Let’s dive in.

PGVector vs Lantern: Similarities and differences​

The following table summarizes some aspects of both extensions:

PgvectorLanternCurrent Version (date)v0.5.1 (Oct 10, 2023)v0.0.11 (Dec 16, 2023)Repo popularity (# of stars)7.6K435Index TypeIVVFlat, HNSWHNSWDistance MetricsL2, Inner, CosineL2, Cosine, HammingSample Index CreationCREATE INDEX ON items USING hnsw (embedding vector_l2_ops) WITH (m=16, ef_construction=64);CREATE INDEX ON small_world USING hnsw (vector dist_l2sq_ops) WITH (M=2, ef_construction=10, ef=4, dim=3);Sample QuerySELECT * FROM items ORDER BY embedding ‘[3,1,2]’ LIMIT 5;SET enable_seqscan=false; SELECT * FROM small_world ORDER BY vector ARRAY[0,0,0] LIMIT 1;

My takeaway is that if you are familiar with one of the extensions, you can easily understand how to use the other. No major complications are expected on that front.

Leveraging ANN-Benchmarks​

For a quantitative comparison, I took the ANN-Benchmarks and extended it to support the Lantern extension. It was just a matter of creating a copy of the Pgvector directory, naming it Lantern and making a few adjustments to use the corresponding API.

The benchmark starts a container that has Postgres 15 installed and then it enables the corresponding extension. Then, it inserts a dataset into a table and builds a vector index (in both cases an HNSW index). After that, it executes a bunch of queries and evaluates the recall.

Along the way, the benchmark collects several metrics, such as:

Build TimeIndex SizeRecallThroughputLatencies (p50, p95, p99 and p999)

So, we can compare the two extensions along these axes.

As for the HNSW parameters, I used the following:

ef_construction{[128], 200}m{[8, 16,] 24}ef_search{10, 20, 40, 80, 120, [128,] 200, 400}

Comparing Index Creation, Recall, Latency and Throughput​

Although I tried different datasets, for brevity, let us only discuss the results of the SIFT 128 dataset, which was also used in one of Lantern’s posts.

These are the numbers I got by following the instructions in the blog post, using similar construction and search parameters (e.g. m={8, 16}, ef_construction=128 and ef_search=128). Here I used Lantern’s external indexer. First, let us see the build time:

Baseline build time

Pgvector takes between 1.71x and 1.73x to build the same index with the same parameters. The resulting index is between 13% and 15% bigger in Pgvector:

Baseline index size

That’s cool… And what about the resulting throughput, latency and recall? Here are the results:

Baseline recall
Baseline throughput
Baseline p95

Ok, the recall is similar, however Pgvector outperforms Lantern in QPS and latencies. Specifically, Pgvector can process between 44% and 53% more queries per second, and it’s latencies are between 29% and 35% smaller.

So, it seems that Lantern sacrifices throughput in exchange of index creation time and index space.

Hold on… but is this true for other data points as well? Let’s see.

With the construction parameters m={16, 24} and ef_construction={200}, the creation time is still better with Lantern: between 1.9X and 2.3X. And the resulting index is bigger in Pgvector: between 1.13X and 1.20X compared to Latern’s index.

Build time
Index Size

Also, as before, the recall is similar when ef_search varies (although Pgvector’s is a bit better). This is the graph for construction parameters ef_construction=200 and m=16. As the ef_search is increased, the recall of both indexes get closer.

Recall

Pgvector has 62-84% better throughput and 38-45% better latencies:

Throughput
Latency

Increasing the m parameter to 24, we get similar conclusions:

Recall

And once again, Pgvector has 42-58% higher throughput and 30-39% better latencies for all values of ef_search:

Throughput
Latency

The general trends were consistent with my observations when using Gist-960 and Glove-200. You can see more results here.

Conclusions​

For convenience, the following table summarizes the above results using relative numbers (i.e. pgvector/lantern):

m={8,16}; ef_construction=128; ef_search=128m={16,24}; ef_construction=200; ef_search=[10-400]NotesBuild Time1.71X-1.73X1.92X-2.35XLantern yields better resultsIndex Size1.13X-1.15X1.13X-1.20XLantern yields better resultsLatency0.64X-0.70X0.54X-0.69XPgvector yields better resultsThroughput1.44X-1.53X1.42X-1.84XPgvector yields better resultsRecall1.00X-1.01X1.00X-1.09XRecall is similar, Pgvector is slightly better

Pgvector is the most popular Postgres extension for vector search. At the time of this writing, the github repository counts 7.6K stars and is actively being discussed on the web. It is also supported on most managed Postgres providers (including Tembo Cloud) so is easier for you to access.

Lantern is a young project that leverages the popular USearch engine. As of today, the extension has been starred more than 400 times in github and is in very active development.

Both extensions offer similar API and support the HNSW index. According to my experiments (Pgvector 0.5.1 and Lantern 0.0.11), Lantern’s index creation is faster and produces smaller indexes. However, Pgvector provides better recall, latency and throughput.

We should keep an eye on both projects and see how they evolve. I am confident that we’ll see several improvements in the following months.

Oh, and if you are interested in quickly integrating vector searches in your app, make sure to check out pg_vectorize to see how to do that with only two function calls in Postgres.

Appendix​

The experiments in this post were carried out using a machine with the following characteristics:

VME2-standard-8 (8 vCPUs, 4 cores, 32GB memory)Storage100GBOperating SystemDebian 11.8Postgres15Postgres Config maintenance_work_mem=5GB; work_mem=2GB; shared_buffers=12GBLantern0.0.11PGVector0.5.1

For information about other results, please see here.

>>> Read full article>>>
Copyright for syndicated content belongs to the linked Source : Hacker News – https://tembo.io/blog/postgres-vector-search-pgvector-and-lantern/

Tags: BenchmarkingPostgrestechnology
Previous Post

Machine embroidery of light-emitting textiles with electroluminescent threads

Next Post

Researchers confirm what we already knew: Google results are getting worse

When Technology Meets Ecology: Charting a Bold Path for Our Planet’s Future

June 21, 2025
‘Jaws’ at 50: Scientists Are Still Studying the Mysteries of Sharks – The New York Times

Jaws at 50: Exploring the Timeless Mysteries of Sharks

June 21, 2025
A Cracked Piece of Metal Self-Healed in Experiment That Stunned Scientists – ScienceAlert

Self-Healing Metal: The Revolutionary Experiment That Amazed Scientists

June 21, 2025
How leading Bollywood actresses are adopting one transformative lifestyle shift – Times of India

How Leading Bollywood Actresses Are Fearlessly Embracing a Bold New Lifestyle Transformation

June 21, 2025
Muskego mom breaks world record in planking – WISN

Muskego mom breaks world record in planking – WISN

June 21, 2025
Russian Minister Warns of Recession as Officials Spar on Economy – Bloomberg

Russian Minister Issues Recession Warning Amid Heated Economic Debate

June 21, 2025
Netflix unveils Dallas immersive venue for fans of hit shows like ‘Squid Game,’ ‘Stranger Things’ – Houston Chronicle

Step Inside Netflix’s New Dallas Immersive Experience Featuring Hits Like ‘Squid Game’ and ‘Stranger Things

June 21, 2025
Breakfast key to meeting daily fiber needs amid American ‘health crisis’ – Fox News

How Breakfast Can Help You Crush Your Daily Fiber Goals During America’s Health Crisis

June 21, 2025
A Senator Who Was on a Hit List Fears the Fueling of Political Violence – The New York Times

Senator on Hit List Sounds Alarm Over Escalating Political Violence

June 21, 2025
Should You Buy Micron Technology Stock Before June 25? – The Motley Fool

Is Now the Perfect Moment to Invest in Micron Technology Before June 25?

June 21, 2025

Categories

Archives

June 2025
MTWTFSS
 1
2345678
9101112131415
16171819202122
23242526272829
30 
« May    
Earth-News.info

The Earth News is an independent English-language daily published Website from all around the World News

Browse by Category

  • Business (20,132)
  • Ecology (696)
  • Economy (710)
  • Entertainment (21,611)
  • General (15,499)
  • Health (9,751)
  • Lifestyle (715)
  • News (22,149)
  • People (713)
  • Politics (717)
  • Science (15,930)
  • Sports (21,206)
  • Technology (15,695)
  • World (690)

Recent News

When Technology Meets Ecology: Charting a Bold Path for Our Planet’s Future

June 21, 2025
‘Jaws’ at 50: Scientists Are Still Studying the Mysteries of Sharks – The New York Times

Jaws at 50: Exploring the Timeless Mysteries of Sharks

June 21, 2025
  • About
  • Advertise
  • Privacy & Policy
  • Contact

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

No Result
View All Result

© 2023 earth-news.info

Go to mobile version