View Full Version : 1.4 limits?
pgolovko
12-09-2005, 04:45 PM
The grande question is .... will v.1.4 handle 1.4 million links? In other words, what is the maximum (reasonable) number of links that eSyndiCat 1.4 can handle at reasonable speed? Simon, have you tried artificially add thousands of random (fake) links to the database, and check the performance? I was thinking of using it for Astanda directory when I'm finished with the spidering software wich might take another month or so. :roll:
Simon Gooffin
12-10-2005, 03:11 AM
hi, we tested eSyndiCat with 30 000 links and it works. I can not say it is extremenly fast. Give me one day and I will tell more facts.
echopulse
12-10-2005, 04:37 AM
That's great Simon! 30,000 is a whole lot in my opinion. I don't see that I would evre have more than one or two thousand in my directory.
Simon Gooffin
12-10-2005, 05:51 AM
:) 1-2 thousands is quite many also. some people are going to have just 50-500 links to promote their websites.. but others are going to build DMOZ or Yahoo like
pgolovko
12-10-2005, 06:50 AM
I dont have 1.4 million links, but I do have some 450,000 links to sort out :?
Right now I'm playing with a small ammount of 15,000 at Astanda.com. Eventually I will need to sort the whole database into categories. I can not immagine myself doing all that work by hand, so I will probably have to write some kind of AI script to sort them. :roll: Thats why I was asking about eSyndiCat limits.
Anyway, please post a reply with your test results.
Thanks!
echopulse
12-12-2005, 02:00 AM
450,000! That's a lot of links man! Surely there must be some overlapping links there. You trying to compete with dmoz or something?
pgolovko
12-12-2005, 04:47 AM
You trying to compete with dmoz or something?
No, I'm not :) Its only programming, web development, and software links.
Simon Gooffin
12-12-2005, 04:55 AM
that's really much
I'm sure you will not add them manually? ARe you working on a spider to get the links?
vBulletin® v3.7.0, Copyright ©2000-2008, Jelsoft Enterprises Ltd.