GLAM Workbench
  • radio_button_unchecked

Trove newspapers: data dashboard¶

Trove's collection of digitised newspapers is always changing – new articles and newspapers are being added by the NLA, while Trove users are busy correcting OCRd text and adding tags and comments. The search you run today might produce different results than the same query did a month ago, a year ago, or ten years ago. Researchers need to understand how these changes affect the queries they make, the results they find, and the arguments they construct. This dashboard helps researchers understand the context of their queries by presenting a snapshot of Trove's digitised newspapers, based on weekly data harvests. It shows Trove's current make up from a number of angles, as well as highlighting recent changes. It is updated every Sunday.

  • Total articles and user activity
  • Total articles by publication year
  • Total articles by publication year and state
  • Article categories
  • Newspaper titles
  • Total articles by publication state
  • Significant events
Last updated: Sunday, 29 October 2023

Total articles and user activity¶

Latest data harvest 29 October 2023
First data harvest 24 April 2022
Total harvests 80
Data https://github.com/wragge/trove-newspaper-totals/blob/master/data/total_articles_by_activity.csv

As of 29 October 2023 there are 242,152,554 digitised newspaper articles in Trove.

  Current total Change since 22 Oct 2023 Change since 01 Oct 2023 Change since 24 Apr 2022 Percentage of total
All articles 242,152,554 140,394 654,532 7,640,464 100.00%
Articles with corrections 15,182,326 16,230 66,642 1,326,787 6.27%
Articles with tags 4,834,015 4,356 15,315 431,021 2.00%
Articles with comments 271,447 397 913 32,756 0.11%

Total articles by publication year¶

Latest data harvest 29 October 2023
First data harvest 19 April 2022
Total harvests 76
Data https://github.com/wragge/trove-newspaper-totals/blob/master/data/total_articles_by_year.csv

This chart shows the total number of digitised newspaper articles by year of publication. The distribution will change over time as digitisation priorities shift and more newspapers are added. This chart is useful in understanding how digitisation priorities and copyright restraints have shaped the total newspaper corpus.


Total articles by publication year and state¶

Latest data harvest 29 October 2023
First data harvest 19 April 2022
Total harvests 76
Data https://github.com/wragge/trove-newspaper-totals/blob/master/data/total_articles_by_year_and_state.csv

This interactive chart helps you explore the distribution of articles by both publication year and state. Click on a state in the bar chart or legend to filter the results by year. Click anywhere in the background of the chart to reset. This enables you to compare digitisation patterns in different states and see how they contribute to the whole corpus.

Total articles added since 22 Oct 2023 by publication year and state

This chart shows the total number of digitised newspaper articles added since the previous harvest by year and place of publication. It's useful in seeing how search results from particular time periods and locations might be affected by current digitisation priorities.

Total articles added since 19 Apr 2022 by publication year and state

This chart shows the total number of digitised newspaper articles added since the first harvest by year and place of publication. It's useful in seeing how search results from particular time periods or locations might be affected by recent digitisation priorities.


Article categories¶

Latest data harvest 29 October 2023
First data harvest 20 April 2022
Total harvests 81
Data https://github.com/wragge/trove-newspaper-totals/blob/master/data/total_articles_by_category.csv
  Current total Change since 22 Oct 2023 Change since 01 Oct 2023 Change since 20 Apr 2022 Percentage of total
Advertising 45,308,098 27,055 141,371 1,806,391 18.711%
Article 167,900,688 96,502 432,650 5,108,228 69.337%
Arts And Culture 4,491 1 5 1,121 0.002%
Classified Advertisements And Notices 1,633 0 93 210 0.001%
Commerce And Business 5,450 22 48 2,454 0.002%
Detailed Lists, Results, Guides 26,964,112 16,416 79,547 712,151 11.135%
Display Advertisement 500 2 4 36 0.000%
Editorial 17,798 11 62 4,391 0.007%
Family Notices 1,993,042 505 1,205 58,239 0.823%
Humour 34,688 22 134 7,180 0.014%
Law, Courts, And Crime 13,253 29 198 3,790 0.005%
Letters 13,946 17 116 1,936 0.006%
Literature 36,130 7 28 1,168 0.015%
News 15,135 83 392 4,717 0.006%
Obituaries 15,143 32 204 4,010 0.006%
Official Appointments And Notices 1,222 0 0 157 0.001%
Puzzles 51,313 1 3 11,381 0.021%
Reviews 3,117 21 60 1,136 0.001%
Shipping Notices 3,081 13 69 1,276 0.001%
Sport And Games 20,356 44 69 5,816 0.008%
Weather 17,067 2 5 7,710 0.007%

Newspaper titles¶

Latest data harvest 29 October 2023
First data harvest 20 April 2022
Total harvests 78
Data https://github.com/wragge/trove-newspaper-totals/blob/master/data/total_articles_by_newspaper.csv

As of 29 October 2023 there are 1,787 different newspapers in Trove.

Total newspapers 1,787
Earliest publication date 05 March 1803
Latest publication date 19 December 2022

Newspapers by state of publication¶

This chart shows the place of publication of newspaper titles in Trove.

Changes in the number of newspapers by state of publication¶

  Current total Change since 22 Oct 2023 Change since 01 Oct 2023 Change since 20 Apr 2022 Percentage of total
ACT 8 0 0 0 0.43%
International 13 0 0 0 0.69%
National 9 0 0 4 0.48%
New South Wales 550 1 3 35 29.30%
Northern Territory 8 0 0 0 0.43%
Queensland 107 0 0 3 5.70%
South Australia 156 0 0 2 8.31%
Tasmania 115 0 0 0 6.13%
Victoria 438 2 2 31 23.34%
Western Australia 382 0 0 32 20.35%

Newspapers added since 22 Oct 2023

  • No newspapers added in this period.

Newspapers added since 01 Oct 2023

title_id title state total link
1862 The Yarrawonga Mercury and Lake Rowan, Tungamah and Mulwala (N.S.W.) News (Vic. : 1882) Victoria 748.000000 https://nla.gov.au/nla.news-title1862
1864 Cessnock Express and Mining and Farming Representative (NSW : 1905 - 1910; 1925 - 1928) New South Wales 12773.000000 https://nla.gov.au/nla.news-title1864
1870 The Gippsland Farmers' and Glengarry, Toongabbie and Cowwarr Journal (Traralgon, Vic. : 1922 - 1923) Victoria 1707.000000 https://nla.gov.au/nla.news-title1870

Changes in the number of articles from newspapers since 22 Oct 2023

title_id title change in articles link
232 The Ballarat Courier (Vic. : 1869 - 1886; 1914 - 1918) 11,992 https://nla.gov.au/nla.news-title232
1492 Border Morning Mail (Albury, NSW : 1934 - 1935; 1938 - 1952) 13,084 https://nla.gov.au/nla.news-title1492
1852 Daily Mirror (Sydney, NSW : 1941 - 1955) 93,634 https://nla.gov.au/nla.news-title1852
1863 nan 13,725 https://nla.gov.au/nla.news-title1863
1864 Cessnock Express and Mining and Farming Representative (NSW : 1905 - 1910; 1925 - 1928) 7,959 https://nla.gov.au/nla.news-title1864

Changes in the number of articles from newspapers since 01 Oct 2023

title_id title change in articles link
232 The Ballarat Courier (Vic. : 1869 - 1886; 1914 - 1918) 11,992 https://nla.gov.au/nla.news-title232
1492 Border Morning Mail (Albury, NSW : 1934 - 1935; 1938 - 1952) 49,259 https://nla.gov.au/nla.news-title1492
1825 The Yarrawonga Mercury and Southern Riverina Advertiser (Vic. : 1897 - 1905; 1913 - 1920) 7,881 https://nla.gov.au/nla.news-title1825
1852 Daily Mirror (Sydney, NSW : 1941 - 1955) 548,450 https://nla.gov.au/nla.news-title1852

Total articles by publication state¶

Data about the number of articles by publication place (state) is available both from the main result API using the state facet, and from the newspaper API. As noted under Significant events, these totals don't always agree. I've included both below, so you can compare.

Number of articles by state of publication (via result API)¶

Number of articles by state of publication (via newspaper API)¶

Changes in the number of articles by state of publication (via result API)¶

  Current total Change since 22 Oct 2023 Change since 01 Oct 2023 Change since 19 Apr 2022 Percentage of total
ACT 3,296,997 0 0 0 1.362%
International 854,022 0 0 2,842 0.353%
National 657,326 0 0 204,582 0.271%
New South Wales 84,761,356 114,677 610,482 1,861,683 35.003%
Northern Territory 409,433 0 0 0 0.169%
Queensland 41,131,526 0 0 41,590 16.986%
South Australia 25,007,977 0 0 445,122 10.327%
Tasmania 15,850,246 0 0 74 6.546%
Victoria 44,807,370 25,717 44,050 4,544,475 18.504%
Western Australia 25,369,631 0 0 679,829 10.477%

Changes in the number of articles by state of publication (via newspaper API)¶

  Current total Change since 22 Oct 2023 Change since 01 Oct 2023 Change since 19 Apr 2022 Percentage of total
ACT 3,296,997 0 0 0 1.362%
International 854,022 0 0 0 0.353%
National 663,996 0 0 211,837 0.274%
New South Wales 84,761,356 119,491 610,482 2,827,699 35.003%
Northern Territory 409,433 0 0 0 0.169%
Queensland 41,131,526 0 0 41,590 16.986%
South Australia 25,007,977 0 0 447,198 10.327%
Tasmania 15,850,246 0 0 74 6.546%
Victoria 44,785,648 14,447 22,328 3,242,593 18.495%
Western Australia 25,369,631 0 0 1,000,269 10.477%

Significant events¶

While the changes documented here generally reflect the addition of new articles and newspapers, the total numbers can also be affected by system configuration and optimisation events, such as rebuilding the index. It's difficult to highlight these sorts of anomalies in the charts above, but where I notice them I'll add a note here.

31 May 2022 – reindex?¶

Between the harvests on 29 May and 5 June 2022 there was a dramatic change in the distribution of articles by state (using the state facet). The number of articles from NSW decreased by 939,065, and the number of articles from Victoria increased by 961,387. There were also some smaller changes affecting other states. There was a scheduled maintenance window on 31 May, which makes me think that these reflect changes in the underlying search index, rather than the actual number of articles. Further evidence for this is the fact that the number of articles per state calculated by using the newspaper API endpoint were out-of-sync with the article totals until the end of May. Since then, both sets of article totals have remained in sync. So, in short, the number of articles returned by the state facet between 19 April 2022 (when my harvests started) and 31 May 2022 can't be trusted.


Created by Tim Sherratt for the GLAM Workbench. Support this project by becoming a GitHub sponsor.