Use datafiles in Python

1. Reading datafile By executing the following script, we can read all data in the JSON file. # Read libraries import json import pandas as pd # Load a JSON file and store in a dictionary f=open('JSON_RDB_test.json','r') dict_all=json.load(f) # Create pandas tables (DataFrames) from the dictionary df_rawdata=pd.DataFrame(dict_all["rawdata"]) df_paper=pd.DataFrame(dict_all["paper"]) df_figure=pd.DataFrame(dict_all["figure"]) df_sample=pd.DataFrame(dict_all["sample"]) df_property=pd.DataFrame(dict_all["property"]) Let's see the contents …

Advertisement

Starrydata API

We have implemented APIs for Starrydata web system. You can get all data associated to specific paper/figure/sample by the following URIs. JSON data for a specific paperid(='sid')/figureid/sampleid https://www.starrydata2.org/api/paper/(paperid) https://www.starrydata2.org/api/figure/(figureid) https://www.starrydata2.org/api/sample/(sampleid) A specific element of an entry https://www.starrydata2.org/api/paper/(paperid)/title https://www.starrydata2.org/api/sample/(sampleid)/composition A list of paperids/figureids/sampleids that contain specific atoms in the sample compositions https://www.starrydata2.org/api/paper/search?atom=Bi,Te https://www.starrydata2.org/api/figure/search?atom=Bi,Te https://www.starrydata2.org/api/sample/search?atom=Bi,Te https://www.starrydata2.org/api/search/search?atom=Bi,Te  (for …

Download datafiles

1. How to download a datafile There are several ways to download datafiles. 1.1. Get Data button Display a list of papers that you want to download data. Press 'Get Data' button. Select the type of the datafile. After pressing, please wait for several minutes until the system loads the all data. This action outputs …

Review paper writers

Has anyone written an unpublished review about a material family? (In thesis etc.) If so, please consider publishing it in collaboration with us. We are providing open data for academic reasons, and the increase in the number of citations will support our projects. Therefore, we need to publish our dataset as citable papers, which includes …

Data addition rate

The plot above shows the number of total records (1 for a curve in a plot) in our Starrydata database. We can see a clear upturn at Dec. 2017, and afterwards, the number of records show a linear increase. This time corresponds when a part-time data collector Yuki Ando joined our team (working 3 days / …

Signup

When you sign up, you can make your own lists of paper, browse datasets, and edit/add datasets. We do not want much of your personal information, but we would like to prepare personal environment for each user, and identify which user added/edited which data. https://www.youtube.com/watch?v=7tVj7hBOIsg?rel=0 Access http://www.starrydata2.org/signup, or click 'Signup' from the menu bar of …

Tutorial

Signup Search papers Access full-text PDFs Add papers to Mylist (paper list) Add papers from DOI list Save data from papers Edit existing data Download datafiles Use datafiles in Python Starrydata API  

Starrydata = Starrydata2 ≠ Starry data

We are sorry about the confusion about the naming of our web system. 'Starry data' is our first web system that did not work well.  'Starrydata' or 'Starrydata2' is the second web system, which we developed from scratch. Both web systems were developed to collect data from plots in published papers efficiently. Unfortunately, the first version …