Releases: rippinrobr/baseball-stats-db
v0.4.1 - Data update
This update includes the changes made in these three commits:
v0.4.0 - 2017 Season Data & Tool Fixes
-
updated database with data from the Baseball Databank commit a6631457706ba61bce6f4be1d01fea6706a065ae on March 30th, 2018.
-
Fixed data type issues in the db loader related to data type changes in some of the columns
v0.3.0
Release Notes
- Added support for MongoDB
- Renamed binary to
databank-dbloader
v0.2.0
Changelog
6abf31f removed --snapshot from goreleaser call
9a56751 added acknowledgment to baseball databank to the readme. Added a section about MySQL along with the records that will not load.
ea1dce1 Merge pull request #5 from rippinrobr/staging
ab36f17 more releases
8457b81 added release task
7877e37 updated mac.goreleaser config file
0a19f47 re-organizing the goreleaser files to per platform
f197226 testing goreleaser
a05307a added dist dir to ignore file
c7fc819 replaced travis file with .goreleaser.yml
aa592f8 removed .travis.yml file
0fb07df added steps for installing dep and installing dependencies
dff0ad6 updated the vet task in make
02a2292 just build it
771c060 fixed go install error in travis file
39258f7 fixed layout of travis file
158c0ea updated makefile so that all builds test and vet prior to building. Added a .travis.yml file to see if I can get the build to work
afe54d2 ran gofmt -s on all files
de8b892 added checks to ensure the inputdir provided is a valid directory.
a2944e1 added -inputdir parameter to dbloader so the executables will actually work in other people's environments
80fbf61 added inputDir property to the structs and a func to set it. Updated GetFilePath to use that to build out the path to the file so that at runtime the user can set the input dir
d20d0e0 updated make to include vet and test
338f248 ran go fmt
9c8b4e0 Updated the readme to the current state of the project
4d0e245 connected to mysql but there's an issue wint Inf in float col
328ee72 added postgres schema and backup
e243986 successfully loaded Postgres and SQLite databases
df8040b moved the supported database constants into the sql_schema.py file and created a list of all supported types so that I don't have to change the command line args when adding new types
163a405 handling the table exist and other exceptions much nicer now
d43697d I'm able to create databases in both mysql and postgres dbs
1b548c7 added information about dbloader
748156b Merge pull request #4 from rippinrobr/staging
16bde63 renamed bdloader to dbloader since we are only loading baseball databank data the exe name appeared as if I flipped the chars.
5f084a9 fixed a typo in the readme
a7ab77d Merge pull request #3 from rippinrobr/staging
1a2bc6d Updated the readme, made corrections to the command line descriptions in the code generation script added a script to generate schemas, added the sqlite schema file to the repo
e73126a Merge pull request #2 from rippinrobr/creating-pks
91e9024 removed commented out code
2c8ce76 all PKs are now in place. Renamed a test file to be a more accurate name and added a test for GetTableObjects() func
07e9a53 AwardsPlayers primary key is set
b9f771f Managers primary key is set
8363002 Update README.md
7a88ad2 Merge pull request #1 from rippinrobr/go-loader-binary
98ab120 Repo funcs have tests
e940709 broke out the mock objects into their own files
b6e60d1 broke out the mock objects into their own files
e974244 added mocks so that I can test the Repo out correctly.
fca7ea7 added mocks so that I can test the Repo out correctly.
9b8c3db added testing for the funcs in db.go
0d3ab13 changed naming convention to be the season followed by the commit hash that corresponds with the data I used to create the db
a0c8f27 added the working SQLite db to the ignore list
13f899d re-org'd the scripts directory structure and broke out the scripts into the two distict directories since they are used for two different purposes.
67e5e7a added the ability to loop through a directory and process all csv files using one script
2369ab0 removed a fmt.Printf from the test files and added the model_test.go file in
3284b89 finished unit tests for generated functions and updated the signature of the generated parse and store func to return errors as well as the func
774489d adding the test files and the repository.go file that was kept out due to .gitignore error
171909c adding the test files and the repository.go file that was kept out due to .gitignore error
c554e6c successfully loaded a SQLite db with generated models.
4bdbe91 added -dbtype, dbconn, and -verbose command line args for the SQLite round
44e3064 Moving towards a more testable Repo
f230696 actually added the database related files
82d2030 created the Repository interface and the SQLiteRepo to manage the connection and Inserting data. Created a TableObject interface that all of the generated Models use.
ad86bd7 - added the generated models to the repo - fixed two bugs in the gen-data-structures.py file - any . in the column name is removed - if a col has an empty data type it is defaulted to string - Configured the Makefile to reflect my project - Added Mac-Makefile so I can test locally without docker
8baf37d updating files to make them project specific and renamed the repository.
3afbc29 copied in the go-build-template files and dirs. removed the python dir
0e6efa5 moved all scripts into the scripts directory including the generators dir
85e5439 removing all javascript and javascript related files'
011265c updated the .gitignore file in preps for using the go-build-template
a956827 created a bash script to generate model files, added a --package option to the gen script that will print out the package for runs with an ouptut dir provided.
a519fd5 changed or to and so it only calls when there's an ouptut dir
d0383df forgot to add the haskell_data_structures.py file to the repo
bf31a17 moved haskell code into its own dir and added the ability to write to an output file.
9cc3e4a added --output-dir parameter to write the code out to the given directory
ef3e96a adding in language specific files, added the three go funcs
2019bf6 renamed the main script for generating data structures to gen-data-structures.py in preps for separating out language specific code into its own files.
a21196c added support for the --db option for go structs
a1039d7 changed the default name to be the name of the file without the file extension
9812052 added tag related command line args --json and --csv so go structs can include those tags.
8a244db added a command line arg to allow the user to write the Sqlite db where they'd like
f105574 seperated out the main function from the sql_schema.py file
9c013ff added ability to change target db from the command line args
7db3a85 removed the create_schema.py script and added a main to the bdb_schema.py file
59df7a3 updated bdb_schema.py to include the new fielding_of_split.csv file and the db schema backup reflects the new table. Also changed the name of master table to people to line up with the changes made to the files.
ece9256 Merge branch 'python-conversion' into data-structure-generator
0e6a655 added json tags to the structure
6cd71bd added support for generating Go datastructures
3e79d35 adding the readme
8a8cc11 successfully generated a haskell object for the Teams.csv file
836d5af successfully flagged the columns for Team.csv correctly
0d86922 prepping for another change
f228e0f successfully created a sqlite db
45692c1 Schema with PKs in place with Peewee classes but haven't been tested yet
40999ab Merge branch 'python-conversion' of github.com:rippinrobr/baseball-databank-scripts into python-conversion
d18e0f7 debugging
2a056ab added .vscode to the gitignore file
57ab925 converted functions into a class and have the basics in place for creating the Peewee models. I need to fix issues with datatypes and add support for primary and foreign keys.
863f2db Parsing is complete working on creating the Peewee code to create the db schema
dc7e8c7 removed the home_games.py file since it is no longer used.
692890b starting to layout the tables and keys
55bba26 parsing is done, now need to work on the storage side of things
f07416d resolved merge conflicts
80b0747 changed the parsing process to just return a dict for each row parsed so that lists of dicts will be passed to the data store code.
2792b4d added home_games.py to parse the home games, updated parse_and_load.py to call home_games and added a func to utils for multi-field keys
1431c89 renamed home_games.py to parks.py after changing my mind on how to handle the home_games file.
a69a0ed Parks.csv is done.
893dfca starting on the home games
64b8a14 added hall of fame data to the players, managers and its own entity. Updated the main file to call the parse funcs on all things completed.
f1df62e season related stats are being parsed.
cd79526 all player files are now being parsed successfullyw :w
c2d0816 added a few more files to the players parser
4cc182e added stats for the regular season and changed the dots to be 40 instead of 20 before a new line
d3e22b4 appearances are now being parsed
c6bd4b6 allstar appearances are now being parsed
b33ea39 succesfully added demographics to the player
8a99644 added a parse func so it can be called from a central script
ab431c2 made process_file func more generic.
689f095 made process_file func more generic.
bb524f5 finished parsing the managers
baa47be changed the processing file to be smarter in the way it grabs the id. it should now be generic enough to process most files
5025a8e Now have all three playerId in col 0 files processing correctly
5fedab7 changed the way the object is initialized and cleaned up an if/else
d202d36 Managers.csv is now being parsed and put into a data structure. Re-orged the project since I'm starting with Python
117c245 Updated link to the baseball databank
27cf1d7 Update README.md
7bb137e finished the updaating of the scripts to import all stats. Removed the load-roster.js since I've decided to handle the players differently.
5c79d63 renamed the seasons related files to teams where appropriate. Updated the load-teams.sh to reflect file name changes. changed load-teams.js and load-teams-managers.js files to reflect the refactoring and the loading of all teams not just the giants
e82fc02 updated ...