Toggle menu
Toggle preferences menu
Toggle personal menu
Not logged in
Your IP address will be publicly visible if you make any edits.

Static Data Export: Difference between revisions

From EVE University Wiki
Added a brief guide about using the SDE, changed it to the new yaml formats. The table still needs some work.
Line 1: Line 1:
{{update|It's no longer an MSSQL Format, it's provided by CCP only as .static and .yaml files. MSSQL still available from FuzzySteve's conversions. Also some ongoing changes to the SDE's format (fsd/bsd)}}
CCP provides developers a series of static files, known as the Static Data Export(SDE), which contains static data from the Tranquility server. The SDE is currently exported as .yaml and .static files, however, different and easier to use formats(mentioned below) are made by the community. The SDE can be found at the EVE developers [https://developers.eveonline.com/resource/resources resource] page. All resources provided by CCP are subject to the [https://developers.eveonline.com/resource/license-agreement license agreement] linked on page.
 
CCP makes available a Microsoft SQL Server data dump file of static data, as it appears in Tranquility Server, for use by the EVE community. This data dump is called the Static Data Export. Along with this dump Image Export collections are also made available. These resources can be found at the EVE developers [https://developers.eveonline.com/resource/resources resource] page. All resources provided by CCP are subject to the [https://developers.eveonline.com/resource/license-agreement license agreement] linked on page.


= Fuzzwork SDE Conversions =
= Fuzzwork SDE Conversions =
To aide fellow developers and players in consuming this data without having to extract or convert from Microsoft SQL Server format every time Steve Ronuken has hosted conversions in PostgreSQL, SQLite and MySQL readable formats. They can be found at [https://www.fuzzwork.co.uk Fuzzwork] under SDE or more directly at [https://www.fuzzwork.co.uk/dump www.fuzzwork.co.uk/dump]. Individual table data can be found in [//en.wikipedia.org/wiki/Comma-separated_values CSV] and [//en.wikipedia.org/wiki/SQL SQL] (MySQL) formats here [https://www.fuzzwork.co.uk/dump/latest www.fuzzwork.co.uk/dump/latest].
To aide fellow developers and players in consuming this data without having to extract or convert from YAML or static format every time Steve Ronuken has hosted conversions in PostgreSQL, SQLite, MySQL, MSSQL, and CSV formats. They can be found at [https://www.fuzzwork.co.uk Fuzzwork] under SDE or more directly at [https://www.fuzzwork.co.uk/dump www.fuzzwork.co.uk/dump]. Individual table data can be found in [//en.wikipedia.org/wiki/Comma-separated_values CSV] and [//en.wikipedia.org/wiki/SQL SQL] (MySQL) formats here [https://www.fuzzwork.co.uk/dump/latest www.fuzzwork.co.uk/dump/latest].
== Opening a file from Fuzzwork SDE Conversions ==
== Opening a file from Fuzzwork SDE Conversions ==
To extract data from compressed files, use [https://ss64.com/bash/tar.html tar] for <code>.tar.bz2</code> files or [https://ss64.com/osx/bzip.html bunzip2] for <code>.bz2</code> files in linux, and something like [http://www.7-zip.org/ 7-zip] for either format in windows.
To extract data from compressed files, use [https://ss64.com/bash/tar.html tar] for <code>.tar.bz2</code> files or [https://ss64.com/osx/bzip.html bunzip2] for <code>.bz2</code> files in linux, and something like [http://www.7-zip.org/ 7-zip] for either format in windows. Once extracted the files can be opened in the appropriate application that supports the file format.
Once extracted the files can be opened in the appropriate application that supports the file format.
 
= How does the ESI fit into all this? =
The [[Eve Swagger Interface]] intends to have endpoints to account for all of the SDE, currently, it's not quite there yet, and the SDE is needed for a lot a projects. The progress can be tracked [https://github.com/esi/esi-issues/issues/1103 here].
 
= How to implement the original SDE into your application =
 
== Step 0: Preface ==
This is not a guide to Python or programming, if you don't know how to program, there are tons of resources to learn to code, there are a few of my favorites in the External Links section down below, if your having issues, contact me at [[User:Asgore Astroficus|Asgore Astroficus]] ([[User talk:Asgore Astroficus|talk]]).
 
== Step 1: Opening the file ==
Firstly, find the file containing the data you need, for this example, I'm going to use fsd/blueprints.yaml. This file contains all the information required to build an industry cost predictor. Next, open the file using your desired programming language, I'm going to use python, so to open this I'll run ''with open("fsd/blueprints.yaml", "r") as f:''. The file is open! To the next step!
 
== Step 2: Reading the file ==
=== Step 2.1: Installing PyYAML ===
Assuming your using pip, this should be as simple as ''pip install pyyaml''. If you having issues, contact me at [[User:Asgore Astroficus|Asgore Astroficus]] ([[User talk:Asgore Astroficus|talk]]) or have a look at [https://stackabuse.com/reading-and-writing-yaml-to-a-file-in-python/ this article].
 
=== Step 2.2: Interpreting the file ===
Now that PyYAML is installed, we need to use it to parse our file, we have already opened it, so it should just be a matter of parsing it with PyYAML, which can be done by ''blueprints = yaml.load(f, Loader=yaml.FullLoader)'', remember to have ''import yaml'' at the top of your .py file. Hopefully now if you print out the blueprints variable, your console will be filled with sweet, sweet data and the taste of success. The data will be a dictionary, and the rest from here should be relatively simple, it should just be navigating through the data as if it was a dictionary.
 
== Step 3: Postface ==
I hope this short guide helped you somewhat getting into the SDE, I might write one for the Fuzzwork conversions soon. If you have any issues, pop me a message here [[User:Asgore Astroficus|Asgore Astroficus]] ([[User talk:Asgore Astroficus|talk]]).


== What each table contains ==
= What each table contains =
{| class="wikitable sortable"
{| class="wikitable sortable"
|-
|-
Line 191: Line 209:
|}
|}


== External links ==
* [https://eveonline-third-party-documentation.readthedocs.io/en/latest/sde/index.html Documentation of the Static Data Export]


[[Category:Applications]]
[[Category:Applications]]