|
Sphinx
Community
Services
Misc
 Subscribe in a reader
|
News entry
Jan 14, 2009. Sphinx goes billions
To my constant amusement, it's not only Sphinx code but also the website that needs some work every now and then, so here's the update.
I've added FAQ section. It's not big yet (only 8 questions covered), and the answers are typically terse, but a start is a start.
Presentations section has a couple new talks. One small step for the page but giant leap for me is that all the previously posted talks were given by ourselves. And now we're not alone - hooray and cheers for Ralf and Mike!
Last but not least, Powered By section, now at 113 sites and counting, was updated and restyled. I had long wondered how much Sphinx search queries are performed per month if we sum all the sites using it, and whether we already hit 1B page views per month or not. Being open-source, there's no easy way to tell. But now with the addition of craigslist to Powered By list I finally know that we do. Many thanks to Jeremy Zawodny who worked hard on making that happen, my itch is no more. :-)
Billions of documents indexed, billions of queries per month. Mind-blowing...
Permalink //
del.icio.us //
digg //
stumble
Comments
|
#1. cysin | 2009-01-14 10:20:07
Great news~
Best wishes to Sphinx~
|
|
#2. Ythan | 2009-01-14 16:57:12, anonymous
That's really remarkable, you're changing the web. :)
|
|
#3. pw | 2009-01-16 05:58:37, anonymous
best wishs to sphinx
can sphinx support chinese word?
|
|
#4. laokanlinux | 2009-01-16 10:35:06, anonymous
when use the sphinx indexer large mysql record (chinese) , the indexer will normal over , but not all the records is indexed. eg have 700000000 record will indexed over 40000000 will be finish ,collect about 3000M docs, This is a bug ?
what is the indexer finshed flag ?
|
|
#5. Shelley Shyan | 2009-01-16 11:00:48
Best wishes!
Reply to pw: It can, and it can support it well
|
|
#6. HonestQiao | 2009-01-16 14:48:21, anonymous
Best wishes to Sphinx!
We support chinese word for sphinx on www.coreseek.com
|
|
#7. Mike Cantelon | 2009-01-16 18:28:32, anonymous
Thanks again for all your work! Sphinx is great software and I'm just, today, rolling out a new Sphinx implementation.Straight.com can be added to the list of sites using Sphinx!
|
|
#8. Glen | 2009-01-16 20:43:11, anonymous
Unfortunately, I'm not allowed to state which site(s) we're running Sphinx on, but we're averaging about 170k searches per month, on a 3M page view a month site.
We've only had it running for a little over two months, and it's no comparison to Craigslist, but we're building the viewership of the site(s) quickly and heavily.
|
|
#9. Galen | 2009-01-18 01:00:12, anonymous
The quality of Chinese language search also pretty much depends on the quality of word segmentation.
I am wondering if we can do just unigram when indexing (though bigger index) and do word segmentation for user submitted search query (or ask users to segment their query, that makes sense as they know what they want to search for). and then we use sphinx to search using, say, maximum length match, and relevance sorting etc.
Does it make sense this way if we can not beat Google/Baidu on word segmentation.
Or any other ways to do Chinese Text Search with Sphinx?
|
|
#10. oopos | 2009-01-21 10:37:25, anonymous
Very good!
Thank you.
Best wishes!
|
|
#11. nzinfo | 2009-02-04 09:29:32, anonymous
http://www.coreseek.com
The Chinese version(Fork) of Sphinx
|
|
#12. AC | 2009-02-04 09:55:21, anonymous
Unfortunately I can't tell you what sites we run Sphinx on (political reasons) but I can tell you that since we started using it in April 2008 (now is February 2009) Sphinx has served 536 million requests for us on our production servers. At the moment our traffic increases exponentially about 20% per month so some quick math says we're currently doing about 100 million sphinx searches per month. That should help with your Billions :)
|
|
#13. Noah | 2009-02-06 05:56:44, anonymous
I'm happy I found this program. It's over 200 times faster then the MySQL/PHP search I made. I use Sphinx so that users can search over 1 million messages on a discussion board in lightning time. Also used to search the rest of the site.
Rave Canada - http://www.rave.ca/
|
|
#14. ethaniel | 2009-02-10 19:48:25, anonymous
Billions are good, but when will we finally see live updates?
|
|
#15. wayan | 2009-02-24 06:42:54, anonymous
I wish it useful for me :D
|
|
#16. organoleptic | 2009-02-27 05:37:52, anonymous
Billions are good, but when will we finally see live updates? <-- agree, live updates are welcome but they should be fast too so make long but good and fast
i use sphinx to search 7.000.000 posts
from start using sphinx, our users made 6 GB of sphinx queries (query.log :P)
|
|
#17. dsds | 2009-03-13 13:56:55, anonymous
dddddddddd
|
|
#18. charlie | 2009-11-15 14:11:11, anonymous
I'm supposed to make korean system.
If you have a korean sysytem, Can I use that??????????
|
Add comment
Name and Comment are required; other fields are optional.
Email will never be displayed nor transferred nor used for anything else except getting back in touch.
Register and then login to skip spambot check and filling your name every time.
Sorry, no markup at all for now.
|
