Tag: retrosheet | TechGraphs
Archive for retrosheet Building a Retrosheet Database for the 2016 Season, Part 2 by David G. Temple March 22, 2016 Hi, folks. Below you will find Part 2 of our video series involving building a Retrosheet database. If you haven’t, make sure to check out Part 1 before digging into this. *The video explains this, but you’ll need to re-download the files from our GitHub page. I found a couple of small errors there. No harm done, just make sure you have the updated files before continuing.
The video explains how to do this. Enjoy! Let me know in the comments or on Twitter if you have any questions or problems. Building a Retrosheet Database for the 2016 Season, Part 1 by David G. Temple March 7, 2016 Baseball season is almost upon us. Soon, people will flood to ballparks in cities all over our great nation in search of entertainment and meaning, while baseball bloggers will continue their search for relevance and the mysterious Full Time Gig.
If you fall into the latter camp (or if you just like having this kind of data handy), then it’s time to get your Retrosheet database installed/updated. For those not in the know, Retrosheet is a magnificent project that essentially looks to turn box scores into computer records. And they’ve done a great job of it. They have all box scores from games since 1914, and play-by-play data since around 1940. What we’ll want to do is convert their records into an easily-searchable database that we can query for fun and profit.
Below is a video walking you through how to get your machine set up. We won’t actually be loading the data yet — that will come in Part 2 — but we’ll make sure your computer is prepped and has all the files and utilities is needs. If you already installed a Retrosheet database using our instructions from last year, most of this won’t apply to you, but feel free to follow along. You’ll certainly need the links to the new packages that are now up on our GitHub page, but most of what you’ll need is in Part 2. (Mac people: as I mentioned in the video, your instructions are coming) Links mentioned in the video: TechGraphs GitHub: https://github.com/techgraphs/2016Ret… MySQL Server: https://dev.mysql.com/downloads/mysql/ Wget: http://gnuwin32.sourceforge.net/packa… 7-Zip: http://www.7-zip.org/ SQLyog: https://github.com/webyog/sqlyog-comm… Building a Retrosheet Database — Part 3 (The Easy/Mac Way) by David G.
Temple March 31, 2015 I’ve worked in technology pretty much all my life, but my first job was on the support desk of a software company. It was consumer software, too, so anybody and everybody called in — professionals, novices, little kids, people who wanted to learn, people who wanted us to do their work for them, and people who didn’t understand how computer mice worked. It was challenging. But I think the hardest part was that our department didn’t have remote software.
This meant that every time a person had a problem, they had to just explain it to us. We couldn’t see what was happening, so we had to trust what the person was saying was accurate. Everybody sees a computer screen differently. Very rarely did a customer see it in the same fashion I was used to seeing it. When I published the first two parts of this Retrosheet series ( Part 1 | Part 2 ), I did not monitor the comments well enough.
I apologize for that. Some people had legitimate questions and I wasn’t there to answer them. I also learned that I was making all of you trust my explanations of things. I was making you see everything through my eyes, and some people got a little confused. This stuff happens. I’m hoping to fix that here. I also promised a way for Mac people to have access to this, so I’m doing that as well. This article/video is for: 1.
Mac (and Linux) users 2. Windows users who had trouble with the first two parts Some caveats for Windows users looking to use this method: 1. The whole point of the first two parts was to show how the SQL files can get made using Chadwick. The idea being that you could grab the 2015 (and all subsequent season) data when that became available. The method mentioned in this article involves installing one flat file. That means that you’ll need to delete all the data and reload it for 2015 next season.
I have no problem making this file for you folks, and will continue to do so as long as TechGraphs and I are around. It’s not a big deal, it’s just a different approach and I wanted to be transparent about that. Mac users basically have to do this method since the Chadwick tools aren’t available for OSX. 2. The video walks Mac users through installing and setting up a MySQL database. Your method differs, and it was explained in parts one and two linked above.
I try to make it clear about when I’m dealing only with Mac users, but I wanted to give you a heads up on that. Everyone using this method will need to download this file. Just save it to the desktop. The video will walk you through the rest. You will also need these two lines of code. The video will tell you how to do it. cd /usr/local/mysql/bin ./mysqladmin -u root password ‘password’ I will be monitoring the comments more closely, so let me know if you have any questions.
Thanks, and good luck. Building a Retrosheet Database – Part 2 by David G. Temple December 30, 2014 Welcome back to TechGraphs’ series on building your own Retrosheet database. If you haven’t already, go back and read part one . If you are interested in actually following along on your own system, you must do some work up front, which all mentioned in that article. If you’ve made it past that point, you’re ready to actually load some baseball data.
Before I get too far into things, I should mention that much of what I will be presenting is an updated version of Colin Wyers’ article at our sister site The Hardball Times. That article is how I first learned to do this install, so many thanks are owed to him for laying down the groundwork. (Note: a lot of these processes will take a good deal of computing resources and time. Be prepared to wait a good deal for these to complete.
I would recommend doing this during a time you won’t need to do much else on your computer.) The first step is to download the .zip file that will contain all the batch files and folder structure you will need. There are two options; one for 32-bit machines and one for 64-bit machines. The files are essentially the same, but the file paths in the scripts vary slightly. Check back with part one if you don’t know if you have a 32- or 64-bit machine.
There are instructions on finding out toward the bottom of the article. Download the proper file and extract it into a new folder on the C:\ drive called Retrosheet, so the result looks like C:\Retrosheet. Open the folder \data\zipped, and run the file get_zip_files batch file. (Note: if you don’t know, batch files are basically strings of code that tell your computer to run multiple processes all at once, saving you a whole lot of clicking.) When you run the get_zip_files file, you’ll notice a lot of scrolling text in the Command Prompt.
This is a good thing. Basically, your computer is downloading all the game files from Retrosheet and unzipping them into usable files. If you back up to the \data\unzipped folder, you’ll notice all the .EVA and .EVN files that were just downloaded. This is the format Retrosheet used for their files. We’ll be using a program called Chadwick to turn these files into MySQL data. Also in that folder are three batch files — $cevent, $cwgame, and $cwsub.
Running these files will parse the data through Chadwick and place the resulting .csv files in the \data\parsed directory. Run each script one time. Be patient, these processes can take some time. You can minimize the Command Prompt window, but DO NOT CLOSE IT. Closing the window ends the process, and you’ll have to clear out the parsed directory and start over again. When the window
The rest of this page is on the live site.