Get acknowledgements from digitised journals

The landing page of a digitised journal in Trove retrieves any acknowledgements using an internal API. In this notebook I've used this API to get acknowledgements from the list of digital journals with OCRd text that I created here.

In [1]:
import requests
from bs4 import BeautifulSoup
import pandas as pd
from tqdm import tqdm_notebook
from IPython.display import display, HTML
In [2]:
url = 'http://nla.gov.au/{}/details/ack'
df = pd.read_csv('digital-journals-with-text.csv', keep_default_na=False)

supporters = []
for row in tqdm_notebook(df.itertuples()):
    ack_url = url.format(row.trove_id)
    response = requests.get(ack_url)
    soup = BeautifulSoup(response.text)
    try:
        acks = soup.find(class_='list-acknowledgements').find_all('strong')
    except AttributeError:
        pass
    else:
        for ack in acks:
            supporters.append({'trove_id': row.trove_id, 'title': row.title, 'supporter': ack.string})

dfs = pd.DataFrame(supporters)

In [3]:
dfs.head()
Out[3]:
supporter title trove_id
0 NSW Soil Conservation Service Journal of soil conservation, New South Wales nla.obj-740911077
1 Chris Edye The New South Wales school magazine of literat... nla.obj-748141557
2 NSW Dept. of Education The New South Wales school magazine of literat... nla.obj-748141557
3 The School Magazine The New South Wales school magazine of literat... nla.obj-748141557
4 State Library of NSW Digital Excellence Program The New South Wales Aborigines' advocate : a m... nla.obj-554406117

Total acknowledgements

In [4]:
dfs['supporter'].value_counts().to_frame()
Out[4]:
supporter
State Library of NSW Digital Excellence Program 56
Department of Veterans’ Affairs 8
State Library of Victoria 5
Lovell Chen 4
University of Melbourne 4
UNSW Australia 4
Victorian Canine Association's Laurie Luxmoore Library 3
Victoria State Government 3
State Library of Queensland 3
Northern Peninsula Area State College 3
Fisheries Research And Development Corporation 3
State Library of New South Wales 3
Chris Edye 3
Public Record Office Victoria 3
The Soft Power, Communications and Scholarships Division of the Department of Foreign Affairs and Trade. 2
Editor of the Bush Fire Bulletin and the NSW Rural Fire Service Library 2
The School Magazine 2
University of Wollongong 2
NSW Dept. of Education 2
Australian Trade and Investment Commission (Austrade) 1
UNSW Canberra Special Collections 1
Bob Maynard 1
NSW Soil Conservation Service 1
Catholic Diocese of Bathurst 1
AEU NSW Teachers Federation Branch in commemoration of their centenary 2018 1
Inside Indonesia 1
RMC Duntroon Classes 1966, 1967 and 1968 for Armistice Centenary 2018 1
Australia Indonesia Institute 1
Herb Feith Foundation 1
Mount Isa Mines, a Glencore Company 1
Mount Isa City Council 1
Daramalan College 1
AustLit, The University of Queensland 1
Open City Inc. RealTime 1
Australian Unity Limited 1
The University of Queensland through a Humanities and Social Sciences Partnership Grant; annotated bibliography supported by the Australian Research Council (DP0984449). 1
Frances Rand and Barbara Farrelly 1
Catholic Church Insurance Limited 1
Tasmanian Archive and Heritage Office (TAHO) 1

Acknowledgements by journal

In [6]:
titles = dfs.groupby('title')
html = ''
for title, supporters in titles:
    html += '<h4>{}</h4><ul>'.format(title)
    for supporter in supporters.itertuples():
        html += '<li>{}</li>'.format(supporter.supporter)  
    html += '</ul>'
display(HTML(html))

Annual report / Repatriation Commission

  • Department of Veterans’ Affairs

Art and architecture (Sydney, N.S.W.)

  • State Library of NSW Digital Excellence Program

Art in Australia

  • University of Wollongong
  • UNSW Australia

Art in Australia : a quarterly magazine

  • University of Wollongong
  • UNSW Australia

Australasian anthropological journal

  • State Library of NSW Digital Excellence Program

Australasian photo-review

  • State Library of NSW Digital Excellence Program

Australia (Sydney, N.S.W. : 1907)

  • State Library of NSW Digital Excellence Program

Australia and the bookfellow

  • State Library of NSW Digital Excellence Program

Australian Aborigines advocate : a monthly record of work amongst the dark people of Australia / the organ of the Australian Aborigines Mission

  • State Library of NSW Digital Excellence Program

Australian art : a monthly magazine & journal

  • State Library of NSW Digital Excellence Program

Australian fisheries

  • Fisheries Research And Development Corporation

Australian fisheries newsletter

  • Fisheries Research And Development Corporation

Australian foreign affairs record

  • The Soft Power, Communications and Scholarships Division of the Department of Foreign Affairs and Trade.

Australian literary journal (Online)

  • State Library of NSW Digital Excellence Program

Australian magazine (Sydney, N.S.W. : 1838)

  • State Library of NSW Digital Excellence Program

Australian magazine (Sydney, N.S.W. : 1899)

  • State Library of NSW Digital Excellence Program

Australian medical journal (1846)

  • State Library of NSW Digital Excellence Program

Australian penny journal (Online)

  • State Library of NSW Digital Excellence Program

Bamaga State High School

  • Northern Peninsula Area State College
  • State Library of Queensland

Bookfellow (Sydney, N.S.W. : 1899)

  • State Library of NSW Digital Excellence Program

Bookfellow (Sydney, N.S.W. : 1907)

  • State Library of NSW Digital Excellence Program

Bookfellow (Sydney, N.S.W. : 1911)

  • State Library of NSW Digital Excellence Program

Building (Sydney, N.S.W. : 1907)

  • State Library of NSW Digital Excellence Program

Building and engineering

  • State Library of NSW Digital Excellence Program

Building, lighting and engineering

  • State Library of NSW Digital Excellence Program

Bush fire bulletin (Sydney, N.S.W.)

  • Editor of the Bush Fire Bulletin and the NSW Rural Fire Service Library

Camp ink

  • State Library of NSW Digital Excellence Program

Current notes on international affairs

  • The Soft Power, Communications and Scholarships Division of the Department of Foreign Affairs and Trade.

Decoration and glass

  • State Library of NSW Digital Excellence Program

Decoration and glass (Online)

  • State Library of NSW Digital Excellence Program

Diggers' digest (Greenslopes Repatriation Hospital)

  • Department of Veterans’ Affairs

Dogs : the K.C.C. Kennel gazette : the official organ of the publisher the Kennel Control Council

  • Victorian Canine Association's Laurie Luxmoore Library
  • Public Record Office Victoria
  • Victoria State Government

Dogs on the bench & in the field (Online)

  • Victorian Canine Association's Laurie Luxmoore Library
  • Public Record Office Victoria
  • Victoria State Government

Education (Sydney, N.S.W.)

  • AEU NSW Teachers Federation Branch in commemoration of their centenary 2018

Everyones

  • State Library of NSW Digital Excellence Program

Fisheries news-letter / issued by the Fisheries Division of the Council for Scientific and Industrial Research

  • Fisheries Research And Development Corporation

Glass (Waterloo, N.S.W. : Online)

  • State Library of NSW Digital Excellence Program

Heads of the people (Sydney, N.S.W.)

  • State Library of NSW Digital Excellence Program

Home (Sydney, N.S.W. : 1920)

  • State Library of NSW Digital Excellence Program

Inside Indonesia : bulletin of the Indonesia Resources and Information Programme

  • Inside Indonesia
  • Australia Indonesia Institute
  • Herb Feith Foundation

Ironside's advertiser and Sydney price current (Online)

  • State Library of NSW Digital Excellence Program

Journal and proceedings (Royal Australian Historical Society)

  • Chris Edye
  • State Library of NSW Digital Excellence Program

Journal of proceedings (Royal Victorian Institute of Architects)

  • Lovell Chen
  • State Library of Victoria
  • University of Melbourne

Journal of proceedings (Victorian Architectural Students' Society of the R.V.I.A.)

  • Lovell Chen
  • State Library of Victoria
  • University of Melbourne

Journal of proceedings of the Royal Victorian Institute of Architects

  • Lovell Chen
  • State Library of Victoria
  • University of Melbourne

Journal of soil conservation, New South Wales

  • NSW Soil Conservation Service

Journal of the Institute of Architects of New South Wales

  • State Library of NSW Digital Excellence Program

Journal of the Royal Military College of Australia

  • RMC Duntroon Classes 1966, 1967 and 1968 for Armistice Centenary 2018
  • UNSW Canberra Special Collections

Journal of the Royal Victorian Institute of Architects

  • Lovell Chen
  • State Library of Victoria
  • University of Melbourne

K.C.C. kennel gazette : the official organ of the publishers, the Kennel Control Council

  • Victorian Canine Association's Laurie Luxmoore Library
  • Public Record Office Victoria
  • Victoria State Government

Lesbians on the loose

  • Frances Rand and Barbara Farrelly

Liberty (Sydney, N.S.W.)

  • State Library of NSW Digital Excellence Program

Magazine / Bamaga P-12 School

  • Northern Peninsula Area State College
  • State Library of Queensland

Mimag / Mount Isa Mines Limited

  • State Library of Queensland
  • Mount Isa Mines, a Glencore Company
  • Mount Isa City Council

Month (Sydney, N.S.W.)

  • State Library of NSW Digital Excellence Program

Murray's Austral-Asiatic review

  • Tasmanian Archive and Heritage Office (TAHO)

Newcastle and Maitland Catholic Sentinel (Online)

  • Catholic Church Insurance Limited
  • State Library of New South Wales

Occupational pamphlet : prepared for the guidance of service men and women who are returning to civil life / by the Ministry of Post-War Reconstruction in collaboration with the Department of Labour and National Service

  • Department of Veterans’ Affairs

Overseas trading

  • Australian Trade and Investment Commission (Austrade)

Penny Saturday journal (Online)

  • State Library of NSW Digital Excellence Program

Photographic review of reviews

  • State Library of NSW Digital Excellence Program

Pix

  • State Library of NSW Digital Excellence Program

Questions and answers (Sydney, N.S.W.)

  • Department of Veterans’ Affairs

Re-establishment pamphlet

  • Department of Veterans’ Affairs

Realtime

  • UNSW Australia
  • Open City Inc. RealTime

Record (Bathurst, N.S.W. : Online)

  • Catholic Diocese of Bathurst

Report of the Repatriation Commission... / Parliament of the Commonwealth of Australia. Australian Soldiers' Repatriation Act

  • Department of Veterans’ Affairs

Rugby League news (Sydney, N.S.W.)

  • State Library of NSW Digital Excellence Program

Science of man and journal of the Royal Anthropological Society of Australasia

  • State Library of NSW Digital Excellence Program

Sitrep (Sydney, N.S.W.)

  • Editor of the Bush Fire Bulletin and the NSW Rural Fire Service Library

Sporting times (Sydney, N.S.W. : 1848 : Online)

  • State Library of NSW Digital Excellence Program

Sydney telephone directory

  • State Library of NSW Digital Excellence Program

Tegg's New South Wales pocket almanac and remembrancer

  • State Library of NSW Digital Excellence Program

Tegg's monthly magazine

  • State Library of NSW Digital Excellence Program

The Australian magazine, or, Compendium of religious, literary, and miscellaneous intelligence

  • State Library of NSW Digital Excellence Program

The Australian quarterly journal of theology, literature & science

  • State Library of NSW Digital Excellence Program

The Australian temperance magazine

  • State Library of NSW Digital Excellence Program

The Australian woman's mirror

  • State Library of NSW Digital Excellence Program

The Blossom

  • State Library of NSW Digital Excellence Program

The Bush brother : a quarterly paper

  • State Library of NSW Digital Excellence Program

The Lone hand

  • State Library of NSW Digital Excellence Program

The New South Wales Aborigines' advocate : a monthly record of missionary work amongst the Aborigines / issued under the auspices of the N.S.W. Aborigines' Mission

  • State Library of NSW Digital Excellence Program

The New South Wales Post Office directory

  • State Library of NSW Digital Excellence Program

The New South Wales school magazine of literature for our boys and girls

  • Chris Edye
  • NSW Dept. of Education
  • The School Magazine

The South-Asian register

  • State Library of NSW Digital Excellence Program

The Sydney coronal / By Charles M'Donald

  • State Library of NSW Digital Excellence Program

The Sydney once a week magazine

  • State Library of NSW Digital Excellence Program

The United Aborigines messenger

  • State Library of NSW Digital Excellence Program

The advance Australia

  • Australian Unity Limited

The bulletin

  • AustLit, The University of Queensland
  • State Library of New South Wales
  • State Library of Victoria

The progress of demobilisation and re-establishment : bulletin

  • Department of Veterans’ Affairs

The school magazine of literature for our boys and girls / the Department of Education, New South Wales

  • Chris Edye
  • NSW Dept. of Education
  • The School Magazine

The wireless weekly : the hundred per cent Australian radio journal / -1943

  • Bob Maynard

Triad (Sydney, N.S.W.)

  • State Library of NSW Digital Excellence Program

Uniken

  • UNSW Australia

Vetaffairs : a newspaper for the veteran community / Veterans' Affairs

  • Department of Veterans’ Affairs

Vision : a literary quarterly / edited by Frank C. Johnson, Jack Lindsay and Kenneth Slessor

  • State Library of NSW Digital Excellence Program

Walkabout (Melbourne, Vic.)

  • The University of Queensland through a Humanities and Social Sciences Partnership Grant; annotated bibliography supported by the Australian Research Council (DP0984449).

Weekly dispatch (Sydney, N.S.W. : Online)

  • State Library of NSW Digital Excellence Program

Will o' the wisp (Online)

  • State Library of New South Wales

Wise's New South Wales post office directory

  • State Library of NSW Digital Excellence Program

[Magazine] / Daramalan College

  • Daramalan College

[Magazine] / Northern Peninsula Area State College

  • Northern Peninsula Area State College
In [ ]: