Know your ISP.

User #121588   1141 posts
Whirlpool Enthusiast

I would like to download 4-5-6 piece endgame tablebase. This exercise could take about 1.2 terabytes and close to 1 year. My suburb does not have ADSL2+.

What is the fastest way possible I can do this? What way would you do it?

posted 2008-May-12, 8am AEST
User #6907   3354 posts
Whirlpool Forums Addict

might be easier to just move to a place with ADSL2+

posted 2008-May-12, 8am AEST
User #70399   1298 posts
Whirlpool Enthusiast

Call Internode and ask if they can develop a custom business system for you. I'm sure they could come up with a plan and price in the range of about $1.2bil/mth.

posted 2008-May-12, 8am AEST
User #19553   376 posts
Forum Regular

I have no idea what you want to download but given the size surely it would be easier to contact the people that have the data and ask them to send it to you on some physical media.

posted 2008-May-12, 8am AEST
User #3462   1187 posts
Whirlpool Enthusiast

Cheapest approach would be to ask a friend to post them from USA. Probably still cheaper to catch a flight to the USA and take two external hard drives.

Alternatively you could hope there is a chess fan at Internode and ask for the files to be added to the mirror server.

posted 2008-May-12, 9am AEST
User #89557   496 posts
Forum Regular

Sneaker net.

www.codinghorror.com/blo...ives/000783.html

posted 2008-May-12, 9am AEST
edited 2008-May-12, 9am AEST
User #10988   13076 posts
ISP Representative

ujj writes...

What is the fastest way possible I can do this? What way would you do it?

Send someone a few 1TB hds and get them to do a copy for you?

Is there a way of generating the table base locally? Do you need to download it or can you just download a piece of code to do it?

posted 2008-May-12, 9am AEST
edited 2008-May-12, 9am AEST
User #167872   894 posts
Whirlpool Enthusiast

taize writes...

I have no idea what you want to download

en.wikipedia.org/wiki/Tablebase

posted 2008-May-12, 9am AEST
User #21463   267 posts
Forum Regular

LittleRascal writes...

Sneaker net.

ROTFL Classic!
I've already sent that link on to lots of others. Thanks :-)

posted 2008-May-12, 9am AEST
User #37748   3114 posts
Whirlpool Forums Addict

Where exactly is this database & who made it???

I've seen some pretty huge chess databases (20GB+ Bookup database) but that just sounds insane...

posted 2008-May-12, 9am AEST
User #206823   42 posts
Participant

A quick Google search shows you can get a generator from here members.chello.at/cm-codeman/TB_Gen.rar

I haven't used this, so I can't say whether this works or not. Is certainly smaller than the 1.2TB you are looking at downloading :-/

posted 2008-May-12, 9am AEST
User #37925   10953 posts
Whirlpool Forums Addict

make it a WP user project.
everyone downloads 4.4gig of it and posts it on DVD? ;)

posted 2008-May-12, 10am AEST
User #15310   1623 posts
Whirlpool Enthusiast

Just get a Telstra Business ADSL2+ (max 20mbs download so not true ADSL2+ but close) unlimited plan. It is about $300/month

posted 2008-May-12, 11am AEST
User #208048   663 posts
Whirlpool Enthusiast

Quick google search seems to indicate most people use emule to get them.

ujj writes...

download 4-5-6 piece endgame tablebase.
BTW: It seems to be a chess solution set database for chess nerds (if you were as curious as I was).

posted 2008-May-12, 11am AEST
User #57328   240 posts
Forum Regular

Wulf-Khan writes...

It seems to be a chess solution set database for chess nerds

All art nerdy - except thee and me - and even thou art a little nerdish............

remove the log from thy own eye before the twig from thy brothers!

etc etc etc....... :-)

posted 2008-May-12, 11am AEST
User #208048   663 posts
Whirlpool Enthusiast

Tack writes...

All art nerdy

Hush! No one denounces louder than he who is most likely to be denounced.

posted 2008-May-12, 11am AEST
User #21463   267 posts
Forum Regular

OT but one more addition to sneaker net :-)

IP over Avian Carriers with Quality of Service
tools.ietf.org/html/rfc2549

posted 2008-May-12, 12pm AEST
User #6258   24096 posts
ISP Representative

Fastest? Sneaker net, I'd suggest (as others have).

Most cost effective via the network? Probably one of Internodes' new Business Unlimited plans at 1500, which would allow > 400 Gb per month in downloads (assuming you're able to run efficiently from the source servers concerned 24x7), and hence would let you pull the lot in 3-4 months.

Simon

posted 2008-May-12, 1pm AEST
User #129037   692 posts
Whirlpool Enthusiast

lol get it mirrored :)

posted 2008-May-12, 1pm AEST
User #40129   345 posts
Forum Regular

If Simon's a chess player he might want it mirrored too!

posted 2008-May-12, 1pm AEST
User #55000   58 posts
Forum Regular

What's the location? I want to see how many files there are. Then maybe I'll get a bunch of nerdy friends together and who knows...

posted 2008-May-12, 2pm AEST
User #18927   1381 posts
Whirlpool Enthusiast

playdude writes...

What's the location? I want to see how many files there are.

ftp://ftp.cis.uab.edu/pub/hyatt/TB/3-4-5

For info on what an endgame tablebase is and how to use it ...

horizonchess.com/FAQ/Win...b.html#%5BA.1%5D

posted 2008-May-12, 3pm AEST
edited 2008-May-12, 3pm AEST
User #45257   652 posts
Whirlpool Enthusiast

Pleiades writes...

ftp://ftp.cis.uab.edu/pub/hyatt/TB/3-4-5

Is that the correct files? If so, it's only like 7GB of data, and should be easily done on an 8Mbit connection in under a week.

posted 2008-May-12, 3pm AEST
User #81627   2836 posts
Whirlpool Forums Addict

Doesnt he want 4-5-6...

I can see 3-4-5-6.
Nalimov/Kadatch 3-4-5-6.

Size, 1.2TB

posted 2008-May-12, 4pm AEST
User #43707   5578 posts
Whirlpool Forums Addict

is the op sure its 1.2tb they need to download?

posted 2008-May-12, 4pm AEST
User #191148   179 posts
Forum Regular

Is this what you're looking for - store.convekta.com/shop_...alog&gid=121? Surely it would be cheaper to buy these premade discs here than download the data yourself.

posted 2008-May-12, 4pm AEST
User #83911   738 posts
Whirlpool Enthusiast

Wulf-Khan writes...

Hush! No one denounces louder than he who is most likely to be denounced.

*HANDS ON HEAD*
"I'm living in a coo-coo clock!"

posted 2008-May-12, 5pm AEST
User #431   76 posts
Forum Regular

Looks like a location that'll be on Internet2. Know anyone who has fast access at a university (AARNet) network? You'd want to check with the right people first, but it's probably a free download for them (and would be super quick too).

posted 2008-May-12, 5pm AEST
User #80498   1567 posts
Whirlpool Enthusiast

Chris Edwards writes...

Looks like a location that'll be on Internet2.

That'd be right, but thats only for 3-4-5. He wants -6 as well. AFAIK, the only place with -6 that is active presently is a huge (!!) set of eMule links. Thats gonna be hard to guarantee the speed on.

To the OP: where were you going to be getting the tables from?

t

posted 2008-May-13, 12pm AEST
User #75163   2630 posts
Whirlpool Forums Addict

The software (C code) to generate the tables is free.

So... For about 1Mb download - generate the suckers yourself.

I'm sure your box is idle most of the time. Setup a batch job to run at low priority. It takes a while (days). Much cheaper than DL.

posted 2008-May-13, 12pm AEST
edited 2008-May-13, 12pm AEST
User #147511   51 posts
Forum Regular

There's a couple of ancient pieces of C code (tbgen?), but they seem pretty ancient/inefficient :/

posted 2008-May-13, 12pm AEST
User #185207   678 posts
Whirlpool Enthusiast

Plantain writes...

There's a couple of ancient pieces of C code (tbgen?), but they seem pretty ancient/inefficient :/

As inefficient as DLing 1.2TB? Vs using wasted clock cycles?

posted 2008-May-13, 12pm AEST
User #147511   51 posts
Forum Regular

With the code I've seen, we're talking several months if not years...

Definitely better to go for the sneakernet...

What would be interesting would be an FPGA or GPU implementation of a table generator... from my limited understanding, both of these would be well suited to such calculations.

posted 2008-May-13, 12pm AEST
User #144891   63 posts
Forum Regular

Never underestimate the bandwidth of a postpack filled with DVDs... Find someone who already owns it and send them a case of beer.

posted 2008-May-13, 12pm AEST
User #147511   51 posts
Forum Regular

I'd suggest just posting a couple of 750GB HD's ;)

This was how I did my file sharing with friends in the Gold Coast back before I had ADSL :P

posted 2008-May-13, 1pm AEST
User #7451   1132 posts
Whirlpool Enthusiast

Plantain writes...

I'd suggest just posting a couple of 750GB HD's ;)

your kidding !???
POST & HDD's , in the same sentence ?!
sure hope you pack them well.

posted 2008-May-13, 1pm AEST
User #147511   51 posts
Forum Regular

Jay Binks writes...

your kidding !???

No?

Electrostatic bag + bubble wrap + those little foam pieces.

Still got the HD's today (Two Seagate 10GB disks)

posted 2008-May-13, 2pm AEST
User #75163   2630 posts
Whirlpool Forums Addict

The way storage is going we may yet have the ultimate 32 pieces EGTB.

:-)

Then we can prove 1. d2-d4 = 1-0
and 1. e2-e4 = 0-1 :-) :-)

[ducks for cover as chess flame war starts]

posted 2008-May-13, 4pm AEST
User #83911   738 posts
Whirlpool Enthusiast

CypherOz writes...

Then we can prove 1. d2-d4 = 1-0
and 1. e2-e4 = 0-1 :-) :-)

[ducks for cover as chess flame war starts]


LOL, I have no idea what that means, but it sounds funny.

posted 2008-May-13, 5pm AEST
User #166425   1196 posts
Whirlpool Enthusiast

I vote other. These stealth Trolls are getting more creative all the time :).

posted 2008-May-13, 5pm AEST
User #32192   15581 posts
Whirlpool Forums Addict

Use Bittorent.

posted 2008-May-13, 6pm AEST
User #69143   2085 posts
Whirlpool Forums Addict

shermozle writes...

Never underestimate the bandwidth of a postpack filled with DVDs.

Filled is the right word, it'd take 270 :|

posted 2008-May-13, 7pm AEST
User #75163   2630 posts
Whirlpool Forums Addict

imprsv writes...

I have no idea what that means, but it sounds funny.

Pawn to Queen 4 (1st move) wins Pawn to King 4 loses.

Some people prefer a queens pawn game and believe it is superior to the king pawn game.

posted 2008-May-13, 8pm AEST
User #66091   8655 posts
Whirlpool Forums Addict

Ken Richards. writes...

Use Bittorent.

You seem to have completely misread the opening post.

posted 2008-May-13, 8pm AEST
User #198964   10 posts
Participant

send them hard drives, or get them to buy some blue-rays, or something either way it would be allot quicker than downloading, Sounds like your rich, you could always buy a dedicated server in one of the data centers in aus (there a few) Download the files via that as they usually have 100mbit connections, then.... buy the hard drive off the hosting company lol. Would be quicker and probably cheaper than paying 300 a month or whatever for a business plan ^-^

posted 2008-May-14, 3am AEST
edited 2008-May-14, 3am AEST
User #56643   462 posts
Forum Regular

I would email the University of Alabama and ask them Direct it to the Computer and Information Services Department. Just ask them how you can get access to this without downloading. The Might offer to stick it on HDDs and post them to you for a nominated fee + profit. DVDs and Blu-ray discs are way too much time and effort needed to split the files and burn them.

Email them and ask.. cant hurt..

posted 2008-May-14, 1pm AEST
User #125233   6 posts
Forum Regular

are you insane. I am amazed at what some people do in there spare time

posted 2008-May-14, 3pm AEST
Hosted by
WebCentral Australia
Big numbers
953,761 threads
16,780,644 posts
1,968,195 whims sent
2,997 wiki topics
236 ISPs listed
8,018 broadband plans
804 modems & routers
39,415 features filled