In January 2017, the University Grants Commission of India released a list of 38,635 Journals that it considers 'genuine' and hence articles published only in these journals will be used for academic performance evaluation.
The last list published was scattered across 5 scanned pdf documents. It was almost impossible to search. The Wire published an analysis of these Journals and found at least 35 of them Predatory
I did an independent analysis and found only 25. The differing numbers arise from the simple fact that those PDFs are hard to parse.
The good news is that UGC re-released the list in text format on April 14th, 2017. However, the bad news is there are as many as 82 journals that overlap with Jeffrey Beall's list now. There probably could be more, since here I just check for an exact match (case-sensitive, equal spaces etc.)
All the data and scripts are hosted here
This notebook is GPLv3 licensed. Please see LICENSE for details.
Update 10th May 2017: Added a clean function to handle inexact matches. The current tally of Journals is 94 (Merging Jan 2017 and Dec 2016 versions of Beall's list). There are 50 predatory publishers.
import pandas as pd
from fuzzywuzzy import fuzz
import re
from fuzzywuzzy import process
pd.set_option('display.max_colwidth', -1)
pd.set_option('display.max_columns', None)
pd.set_option('display.max_rows', None)
def clean_name(x):
## Remove things in braces such as :
## Journal of Food, Agriculture and Environment (JFAE) => Journal of Food, Agriculture and Environment
cleaned = re.sub(r"\(([A-Za-z0-9_]+)\)", '', x).strip()
cleaned = re.sub( '\s+', ' ', cleaned ).strip()
cleaned = unicode(cleaned.lower().replace('&', 'and'), 'utf-8')
return cleaned
with open('Beall_list_dec2016.txt') as f:
beall_list_dec = [clean_name(x.strip()) for x in f.readlines()]
df = pd.read_csv('UGC_Journal_list_2017.csv')
df.Title = df.Title.apply(clean_name)
df.Publisher = df.Publisher.astype(str).apply(clean_name)
exact_matches_dec2016 = pd.DataFrame({'Journals': list(set(df.Title).intersection(beall_list_dec))})
#fuzzy_matches = [process.extractOne(x, beall_list_dec) for x in set(df.Title)]
exact_matches_dec2016.sort_values(by='Journals').reset_index(drop=True)
Journals | |
---|---|
0 | actual problems of economics |
1 | african journal of traditional, complementary and alternative medicines |
2 | aging |
3 | al ameen journal of medical sciences |
4 | asian journal of chemistry |
5 | asian journal of pharmaceutical research and health care |
6 | asian pacific journal of tropical disease |
7 | australasian medical journal |
8 | australian journal of basic and applied sciences |
9 | biomedical and pharmacology journal |
10 | bionano frontier |
11 | bioscience discovery |
12 | biosciences, biotechnology research asia |
13 | cellular and molecular biology |
14 | clinics in oncology |
15 | current botany |
16 | der pharma chemica |
17 | european journal of economics, finance and administrative sciences |
18 | european journal of science and theology |
19 | european journal of scientific research |
20 | european journal of social sciences |
21 | genes and cancer |
22 | genetics and molecular research |
23 | global media journal |
24 | indian journal of scientific research |
25 | interdisciplinary toxicology |
26 | international archives of medicine |
27 | international journal of applied linguistics and english literature |
28 | international journal of applied research in natural products |
29 | international journal of biomedical science |
30 | international journal of collaborative research on internal medicine and public health |
31 | international journal of communication networks and information security |
32 | international journal of computer science issues |
33 | international journal of current pharmaceutical review and research |
34 | international journal of current research and review |
35 | international journal of drug development and research |
36 | international journal of electrochemical science |
37 | international journal of engineering and technology |
38 | international journal of health research |
39 | international journal of network security |
40 | international journal of pharma and bio sciences |
41 | international journal of pharmaceutical and clinical research |
42 | international journal of pharmaceutical and phytopharmacological research |
43 | international journal of pharmaceutical research and development |
44 | international journal of pharmaceutical sciences and drug research |
45 | international journal of pharmaceutical sciences and research |
46 | international journal of pharmaceutical sciences review and research |
47 | international journal of pharmacognosy |
48 | international journal of pharmacognosy and phytochemical research |
49 | international journal of pharmacy and pharmaceutical sciences |
50 | international journal of pharmacy and technology |
51 | international journal of renewable energy research |
52 | international journal of research in ayurveda and pharmacy |
53 | international journal of sustainable development |
54 | international journal of toxicological and pharmacological research |
55 | international proceedings of chemical, biological and environmental engineering |
56 | international research journal of finance and economics |
57 | international research journal of pharmacy |
58 | journal of accounting, ethics and public policy |
59 | journal of animal and plant sciences |
60 | journal of applied linguistics |
61 | journal of applied pharmaceutical science |
62 | journal of chemical and pharmaceutical research |
63 | journal of chemical and pharmaceutical sciences |
64 | journal of clinical and analytical medicine |
65 | journal of computers |
66 | journal of electrical engineering |
67 | journal of environmental biology |
68 | journal of environmental hydrology |
69 | journal of language and literature |
70 | journal of materials and environmental science |
71 | journal of natural products |
72 | journal of pharmacy research |
73 | journal of physical therapy science |
74 | journal of psychology and theology |
75 | journal of software |
76 | journal of theoretical and applied information technology |
77 | mathematical and computational applications |
78 | national journal of community medicine |
79 | oncoscience |
80 | oncotarget |
81 | oriental journal of computer science and technology |
82 | pharmacie globale: international journal of comprehensive pharmacy |
83 | pharmacologyonline |
84 | research journal of pharmaceutical, biological and chemical sciences |
85 | researchers world - journal of arts science and commerce |
86 | romanian biotechnological letters |
87 | scholarly research exchange |
88 | sport science |
89 | technics technologies education management |
90 | the criterion: an international journal in english |
91 | turkish online journal of educational technology |
92 | world applied sciences journal |
Update for Beall's list Jan 2017 version. For some reason, the total count reduces to 43.
with open('Beall_list_Jan2017.txt') as f:
beall_list_jan = [clean_name(x.strip()) for x in f.readlines()]
exact_matches_jan2017 = pd.DataFrame({'Journals': list(set(df.Title).intersection(beall_list_jan))})
exact_matches_jan2017.sort_values(by='Journals').reset_index(drop=True)
Journals | |
---|---|
0 | african journal of traditional, complementary and alternative medicines |
1 | aging |
2 | al ameen journal of medical sciences |
3 | asian journal of chemistry |
4 | asian journal of pharmaceutical research and health care |
5 | asian pacific journal of tropical disease |
6 | australasian medical journal |
7 | australian journal of basic and applied sciences |
8 | biomedical and pharmacology journal |
9 | bionano frontier |
10 | bioscience discovery |
11 | biosciences, biotechnology research asia |
12 | cellular and molecular biology |
13 | clinics in oncology |
14 | current botany |
15 | der pharma chemica |
16 | european journal of science and theology |
17 | european journal of scientific research |
18 | genes and cancer |
19 | genetics and molecular research |
20 | global media journal |
21 | indian journal of scientific research |
22 | interdisciplinary toxicology |
23 | international archives of medicine |
24 | international journal of applied linguistics and english literature |
25 | international journal of applied research in natural products |
26 | international journal of biomedical science |
27 | international journal of collaborative research on internal medicine and public health |
28 | international journal of communication networks and information security |
29 | international journal of computer science issues |
30 | international journal of current pharmaceutical review and research |
31 | international journal of current research and review |
32 | international journal of drug development and research |
33 | international journal of electrochemical science |
34 | international journal of engineering and technology |
35 | international journal of health research |
36 | international journal of network security |
37 | international journal of pharma and bio sciences |
38 | international journal of pharmaceutical and clinical research |
39 | international journal of pharmaceutical and phytopharmacological research |
40 | international journal of pharmaceutical research and development |
41 | international journal of pharmaceutical sciences and drug research |
42 | international journal of pharmaceutical sciences and research |
43 | international journal of pharmaceutical sciences review and research |
44 | international journal of pharmacognosy |
45 | international journal of pharmacognosy and phytochemical research |
46 | international journal of pharmacy and technology |
47 | international journal of renewable energy research |
48 | international journal of toxicological and pharmacological research |
49 | international proceedings of chemical, biological and environmental engineering |
50 | international research journal of finance and economics |
51 | international research journal of pharmacy |
52 | journal of accounting, ethics and public policy |
53 | journal of applied linguistics |
54 | journal of applied pharmaceutical science |
55 | journal of chemical and pharmaceutical research |
56 | journal of chemical and pharmaceutical sciences |
57 | journal of clinical and analytical medicine |
58 | journal of computers |
59 | journal of electrical engineering |
60 | journal of environmental biology |
61 | journal of environmental hydrology |
62 | journal of food, agriculture and environment |
63 | journal of language and literature |
64 | journal of materials and environmental science |
65 | journal of natural products |
66 | journal of pharmacy research |
67 | journal of physical therapy science |
68 | journal of psychology and theology |
69 | journal of software |
70 | journal of theoretical and applied information technology |
71 | mathematical and computational applications |
72 | national journal of community medicine |
73 | oncoscience |
74 | oncotarget |
75 | oriental journal of computer science and technology |
76 | pharmacie globale: international journal of comprehensive pharmacy |
77 | pharmacologyonline |
78 | research journal of pharmaceutical, biological and chemical sciences |
79 | romanian biotechnological letters |
80 | scholarly research exchange |
81 | sport science |
82 | technics technologies education management |
83 | the criterion: an international journal in english |
84 | turkish online journal of educational technology |
85 | world applied sciences journal |
overlap_jan_dec = pd.concat([exact_matches_dec2016, exact_matches_jan2017]).drop_duplicates().sort_values(by='Journals').reset_index(drop=True)
overlap_jan_dec
Journals | |
---|---|
0 | actual problems of economics |
1 | african journal of traditional, complementary and alternative medicines |
2 | aging |
3 | al ameen journal of medical sciences |
4 | asian journal of chemistry |
5 | asian journal of pharmaceutical research and health care |
6 | asian pacific journal of tropical disease |
7 | australasian medical journal |
8 | australian journal of basic and applied sciences |
9 | biomedical and pharmacology journal |
10 | bionano frontier |
11 | bioscience discovery |
12 | biosciences, biotechnology research asia |
13 | cellular and molecular biology |
14 | clinics in oncology |
15 | current botany |
16 | der pharma chemica |
17 | european journal of economics, finance and administrative sciences |
18 | european journal of science and theology |
19 | european journal of scientific research |
20 | european journal of social sciences |
21 | genes and cancer |
22 | genetics and molecular research |
23 | global media journal |
24 | indian journal of scientific research |
25 | interdisciplinary toxicology |
26 | international archives of medicine |
27 | international journal of applied linguistics and english literature |
28 | international journal of applied research in natural products |
29 | international journal of biomedical science |
30 | international journal of collaborative research on internal medicine and public health |
31 | international journal of communication networks and information security |
32 | international journal of computer science issues |
33 | international journal of current pharmaceutical review and research |
34 | international journal of current research and review |
35 | international journal of drug development and research |
36 | international journal of electrochemical science |
37 | international journal of engineering and technology |
38 | international journal of health research |
39 | international journal of network security |
40 | international journal of pharma and bio sciences |
41 | international journal of pharmaceutical and clinical research |
42 | international journal of pharmaceutical and phytopharmacological research |
43 | international journal of pharmaceutical research and development |
44 | international journal of pharmaceutical sciences and drug research |
45 | international journal of pharmaceutical sciences and research |
46 | international journal of pharmaceutical sciences review and research |
47 | international journal of pharmacognosy |
48 | international journal of pharmacognosy and phytochemical research |
49 | international journal of pharmacy and pharmaceutical sciences |
50 | international journal of pharmacy and technology |
51 | international journal of renewable energy research |
52 | international journal of research in ayurveda and pharmacy |
53 | international journal of sustainable development |
54 | international journal of toxicological and pharmacological research |
55 | international proceedings of chemical, biological and environmental engineering |
56 | international research journal of finance and economics |
57 | international research journal of pharmacy |
58 | journal of accounting, ethics and public policy |
59 | journal of animal and plant sciences |
60 | journal of applied linguistics |
61 | journal of applied pharmaceutical science |
62 | journal of chemical and pharmaceutical research |
63 | journal of chemical and pharmaceutical sciences |
64 | journal of clinical and analytical medicine |
65 | journal of computers |
66 | journal of electrical engineering |
67 | journal of environmental biology |
68 | journal of environmental hydrology |
69 | journal of food, agriculture and environment |
70 | journal of language and literature |
71 | journal of materials and environmental science |
72 | journal of natural products |
73 | journal of pharmacy research |
74 | journal of physical therapy science |
75 | journal of psychology and theology |
76 | journal of software |
77 | journal of theoretical and applied information technology |
78 | mathematical and computational applications |
79 | national journal of community medicine |
80 | oncoscience |
81 | oncotarget |
82 | oriental journal of computer science and technology |
83 | pharmacie globale: international journal of comprehensive pharmacy |
84 | pharmacologyonline |
85 | research journal of pharmaceutical, biological and chemical sciences |
86 | researchers world - journal of arts science and commerce |
87 | romanian biotechnological letters |
88 | scholarly research exchange |
89 | sport science |
90 | technics technologies education management |
91 | the criterion: an international journal in english |
92 | turkish online journal of educational technology |
93 | world applied sciences journal |
1250 Beall_list_dec2016.txt
1310 Beall_list_Jan2017.txt
1112 Beall_list_oct2016.txt
with open('Beall_publisher_list_Dec2016.txt') as f:
beall_pubisher_list_dec = [clean_name(x.strip()) for x in f.readlines()]
publisher_matches_dec2016 = pd.DataFrame({'Publisher': list(set(df.Publisher).intersection(beall_pubisher_list_dec))})
publisher_matches_dec2016.sort_values(by='Publisher').reset_index(drop=True)
Publisher | |
---|---|
0 | academic journals |
1 | academic journals, inc. |
2 | advanced research journals |
3 | allied academies |
4 | ame publishing company |
5 | american scientific publishers |
6 | astonjournals |
7 | australian international academic centre pty. ltd. |
8 | baishideng publishing group |
9 | business perspectives |
10 | canadian center of science and education |
11 | cardiology academic press |
12 | ceser publications |
13 | ctr publications |
14 | digital information research foundation |
15 | e-century publishing corporation |
16 | econjournals |
17 | engineering and technology publishing |
18 | frontiers in bioscience |
19 | global research online |
20 | hikari ltd. |
21 | indian society for education and environment |
22 | infofacility |
23 | institute of advanced scientific research |
24 | institute of integrative omics and applied biotechnology |
25 | international academy of business and economics |
26 | international digital organization for scientific information |
27 | international information institute |
28 | international scientific publications |
29 | internet scientific publications |
30 | keja publications |
31 | lifescience global |
32 | marsland press |
33 | medwell journals |
34 | natural sciences publishing corporation |
35 | north atlantic university union |
36 | pushpa publishing house |
37 | research india publications |
38 | sadguru publications |
39 | scholars research library |
40 | science alert |
41 | science and engineering research support society |
42 | science publications |
43 | scientific journals international |
44 | society of education |
45 | the academy of business and retail management |
46 | vbri press |
47 | wfl publisher |
48 | wit press |
49 | world scientific and engineering academy and society |
with open('Beall_publisher_list_Jan2017.txt') as f:
beall_pubisher_list_jan = [clean_name(x.strip()) for x in f.readlines()]
publisher_matches_jan2017 = pd.DataFrame({'Publisher': list(set(df.Publisher).intersection(beall_pubisher_list_jan))})
publisher_matches_jan2017.sort_values(by='Publisher').reset_index(drop=True)
Publisher | |
---|---|
0 | academic journals |
1 | academic journals, inc. |
2 | advanced research journals |
3 | allied academies |
4 | ame publishing company |
5 | american scientific publishers |
6 | astonjournals |
7 | australian international academic centre pty. ltd. |
8 | baishideng publishing group |
9 | business perspectives |
10 | canadian center of science and education |
11 | cardiology academic press |
12 | ceser publications |
13 | ctr publications |
14 | digital information research foundation |
15 | e-century publishing corporation |
16 | econjournals |
17 | engineering and technology publishing |
18 | frontiers in bioscience |
19 | global research online |
20 | hikari ltd. |
21 | indian society for education and environment |
22 | infofacility |
23 | institute of advanced scientific research |
24 | institute of integrative omics and applied biotechnology |
25 | international academy of business and economics |
26 | international digital organization for scientific information |
27 | international information institute |
28 | international scientific publications |
29 | internet scientific publications |
30 | keja publications |
31 | lifescience global |
32 | marsland press |
33 | medwell journals |
34 | natural sciences publishing corporation |
35 | north atlantic university union |
36 | pushpa publishing house |
37 | research india publications |
38 | sadguru publications |
39 | scholars research library |
40 | science alert |
41 | science and engineering research support society |
42 | science publications |
43 | scientific journals international |
44 | society of education |
45 | the academy of business and retail management |
46 | vbri press |
47 | wfl publisher |
48 | wit press |
49 | world scientific and engineering academy and society |
overlap_pub_jan_dec = pd.concat([publisher_matches_dec2016, publisher_matches_jan2017]).drop_duplicates().sort_values(by='Publisher').reset_index(drop=True)
overlap_pub_jan_dec
Publisher | |
---|---|
0 | academic journals |
1 | academic journals, inc. |
2 | advanced research journals |
3 | allied academies |
4 | ame publishing company |
5 | american scientific publishers |
6 | astonjournals |
7 | australian international academic centre pty. ltd. |
8 | baishideng publishing group |
9 | business perspectives |
10 | canadian center of science and education |
11 | cardiology academic press |
12 | ceser publications |
13 | ctr publications |
14 | digital information research foundation |
15 | e-century publishing corporation |
16 | econjournals |
17 | engineering and technology publishing |
18 | frontiers in bioscience |
19 | global research online |
20 | hikari ltd. |
21 | indian society for education and environment |
22 | infofacility |
23 | institute of advanced scientific research |
24 | institute of integrative omics and applied biotechnology |
25 | international academy of business and economics |
26 | international digital organization for scientific information |
27 | international information institute |
28 | international scientific publications |
29 | internet scientific publications |
30 | keja publications |
31 | lifescience global |
32 | marsland press |
33 | medwell journals |
34 | natural sciences publishing corporation |
35 | north atlantic university union |
36 | pushpa publishing house |
37 | research india publications |
38 | sadguru publications |
39 | scholars research library |
40 | science alert |
41 | science and engineering research support society |
42 | science publications |
43 | scientific journals international |
44 | society of education |
45 | the academy of business and retail management |
46 | vbri press |
47 | wfl publisher |
48 | wit press |
49 | world scientific and engineering academy and society |