Use datafiles in Python

1. Reading datafile By executing the following script, we can read all data in the JSON file. # Read libraries import json import pandas as pd # Load a JSON file and store in a dictionary f=open('JSON_RDB_test.json','r') dict_all=json.load(f) # Create pandas tables (DataFrames) from the dictionary df_rawdata=pd.DataFrame(dict_all["rawdata"]) df_paper=pd.DataFrame(dict_all["paper"]) df_figure=pd.DataFrame(dict_all["figure"]) df_sample=pd.DataFrame(dict_all["sample"]) df_property=pd.DataFrame(dict_all["property"]) Let's see the contents …

Advertisement

Starrydata API

We have implemented APIs for Starrydata web system. You can get all data associated to specific paper/figure/sample by the following URIs. JSON data for a specific paperid(='sid')/figureid/sampleid https://www.starrydata2.org/api/paper/(paperid) https://www.starrydata2.org/api/figure/(figureid) https://www.starrydata2.org/api/sample/(sampleid) A specific element of an entry https://www.starrydata2.org/api/paper/(paperid)/title https://www.starrydata2.org/api/sample/(sampleid)/composition A list of paperids/figureids/sampleids that contain specific atoms in the sample compositions https://www.starrydata2.org/api/paper/search?atom=Bi,Te https://www.starrydata2.org/api/figure/search?atom=Bi,Te https://www.starrydata2.org/api/sample/search?atom=Bi,Te https://www.starrydata2.org/api/search/search?atom=Bi,Te  (for …

Download datafiles

1. How to download a datafile There are several ways to download datafiles. 1.1. Get Data button Display a list of papers that you want to download data. Press 'Get Data' button. Select the type of the datafile. After pressing, please wait for several minutes until the system loads the all data. This action outputs …

Review paper writers

Has anyone written an unpublished review about a material family? (In thesis etc.) If so, please consider publishing it in collaboration with us. We are providing open data for academic reasons, and the increase in the number of citations will support our projects. Therefore, we need to publish our dataset as citable papers, which includes …

Data addition rate

The plot above shows the number of total records (1 for a curve in a plot) in our Starrydata database. We can see a clear upturn at Dec. 2017, and afterwards, the number of records show a linear increase. This time corresponds when a part-time data collector Yuki Ando joined our team (working 3 days / …

Edit existing data

Users can edit existing data, if any mistakes of the previous data collector is found. https://www.youtube.com/watch?v=FbOKnKK7nRI?rel=0

Save data from papers

By clicking 'Data' for the paper of interest, users can start data collection. WebPlotDigitizer (External web system) is embedded at the bottom of the page, to extract data from images. https://www.youtube.com/watch?v=9LFXtAHlNnU?rel=0 Click 'Edit' button at the right top of the gray region, to show up Save button. (The 'Edit' button had not been implemented in …

Access full-text PDFs

Unlike other reference managers, Starrydata does not store full-text PDF of each paper. We only provide links for each paper on the publisher's web site. If the user has access to the full-text, they can open the full-text in the web browser. We just store bibliographic information, which is displayed in 'Details'. If the automatically …

Add papers from DOI list

You can add multiple papers to the paper list, from a list of DOI (1 DOI in 1 line). If  the system already has a paper with the DOI, it simply adds the paper to the paper list. If  the system doesn't have a paper with the DOI, the system accesses CrossRef.org to retrieve bibliographic information …

Add papers to Mylist (paper list)

https://www.youtube.com/watch?v=dYpkF-QVy3Y?rel=0 Create a new list Input the title of the list. Click the '+' in front of 'Create List'. Add papers from search results Show the search results. Check the papers you want to add. If you want to check all papers in the search results, increase the number of the papers per page to …