Yeah, I've worked with big data before. I can do impossible
things in Excel and have. Millions of lines of data? Easy.
Process it via Excel VBA Script instead of inside of the sheets
themselves. it worked great back in 1999-2002. Hadoop and such
are MUCH better options now though. The column based DBMS offer
a decent replacement for messy spreadsheets finally, at least
for certain purposes.
One of my setups BEAT Microstrategy which they tried to replace
me with. Two millions dollars they wasted on a team of
consultants because they DIDN'T LISTEN. They got to the proof of
concept phase and wanted the thousands of files I processed via
Excel/VBA to be uploaded one at a time, maximum 5 per page.. on
the WEB.
In 2002, "Put it on the Web" was the magic buzz cure.
They'd call it "Cloud" now. Fucktards. I left for FL in 2002.
Stayed in use at least until 2013 that I'm aware of. I trained a
team of three people on my code so they could modify it for
future Schering-Plough new release products.
Then again... Schering was absorbed by Merck at some point a few
years ago... so maybe my spreadsheets+ code sucked...(it was a
mess and no, I didn't take down the company tongue emoticon )
although really it was just one of those mergers that needed to
happen forever.
"Data Cube" was the buzzword then. Asshats in suits.
