Let's now play with JSON to access the NARA Catalog Morgenthau Diary Vol.696: Jan. 22 - Jan. 26, 1944:¶
- we use an API call where we specify a NARA fileUnit ID directly: 28277406¶
- https://catalog.archives.gov/api/v2/records/search?q=*&abbreviated=true&limit=200&naId=28277406
 |
 |
In [22]:
import requests
import json
# Going down the JSON tree to the RESULT section:
response = requests.get("https://catalog.archives.gov/api/v2/records/search?q=*&abbreviated=true&limit=200&naId=28277406",
headers={"Content-Type": "application/json",
"x-api-key": "API-KEY"})
data = response.json()
with open('data.FU.json', 'w') as f:
json.dump(data, f)
result = data["body"]["hits"]["hits"][0]
fields = result["fields"]
record = result["_source"]["record"]
result
Out[22]:
{'_index': 'nac-records2',
'_type': '_doc',
'_id': '28277406',
'_score': 28.70905,
'_source': {'record': {'generalRecordsTypes': ['Textual Records'],
'levelOfDescription': 'fileUnit',
'recordType': 'description',
'ancestors': [{'collectionIdentifier': 'FDR-MORGEN',
'inclusiveStartDate': {'year': 1866, 'logicalDate': '1866-01-01'},
'distance': 2,
'levelOfDescription': 'collection',
'inclusiveEndDate': {'year': 1960, 'logicalDate': '1960-12-31'},
'title': 'Henry Morgenthau, Jr. Papers',
'naId': 589184},
{'inclusiveStartDate': {'month': 4,
'year': 1933,
'day': 27,
'logicalDate': '1933-04-27'},
'distance': 1,
'levelOfDescription': 'series',
'creators': [{'creatorType': 'Most Recent',
'heading': 'Morgenthau, Henry, 1891-1967',
'deathDate': {'year': 1967, 'logicalDate': '1967-12-31'},
'authorityType': 'person',
'birthDate': {'year': 1891, 'logicalDate': '1891-01-01'},
'naId': 10581613}],
'inclusiveEndDate': {'month': 7,
'year': 1945,
'day': 21,
'logicalDate': '1945-07-21'},
'title': 'Diaries of Henry Morgenthau, Jr.',
'naId': 589213}],
'title': 'Volume 696, January 22 – January 26, 1944',
'naId': 28277406,
'physicalOccurrences': [{'mediaOccurrences': [{'generalMediaTypes': ['Loose Sheets'],
'specificMediaType': 'Paper'}]}]}},
'fields': {'totalDigitalObjects': [1],
'firstDigitalObject': [{'objecId': '28277407',
'objectUrl': 'https://s3.amazonaws.com/NARAprodstorage/opastorage/live/6/2774/28277406/content/presidential-libraries/roosevelt/FDR-MORGEN/589213/md0981.pdf',
'objectType': 'Portable Document File (PDF)'}]},
'sort': [28.70905, '28277406']}
How to extract the TITLE value from the JSON tree¶
In [20]:
title_value = record["title"]
# Printing the Title Value
print( "- TITLE VALUE:", title_value )
- TITLE VALUE: Volume 696, January 22 – January 26, 1944
How to extract the URL value from the FILE section of the objects/object portion of the JSON tree¶
In [27]:
# Going down to the fiole section of the objects/object portion of the JSON tree
object = fields["firstDigitalObject"][0]
# Grabbing the @url value
object_url = object["objectUrl"]
# We choose to print the URL key which will give us the location of the file
print( "- URL VALUE:", object_url)
# Grabbing the @name value
object_id = object["objecId"]
# Printing the name value
print( "- NAME VALUE:", object_id)
- URL VALUE: https://s3.amazonaws.com/NARAprodstorage/opastorage/live/6/2774/28277406/content/presidential-libraries/roosevelt/FDR-MORGEN/589213/md0981.pdf - NAME VALUE: 28277407
==> Follow the URL link and "GET" the actual .PDF file for the entire Morgenthau Diary for Volume 696 and download it locally¶
In [29]:
# We then get that URL
r = requests.get(object_url, allow_redirects=True)
# and finally open and write the .PDF file
open('696.pdf', 'wb').write(r.content)
Out[29]:
20024779
In [ ]: