Analysis of web scraping techniques to get keywords suggestion and allintitle automatically from Google Search Engines

Aris Wahyu Murdiyanto, Adri Priadana

Submitted : 2021-08-14, Published : 2021-11-30.


Keyword research is one of the essential activities in Search Engine Optimization (SEO). One of the techniques in doing keyword research is to find out how many articles titles on a website indexed by the Google search engine contain a particular keyword or so-called "allintitle". Moreover, search engines are also able to provide keywords suggestion. Getting keywords suggestions and allintitle will not be effective, efficient, and economical if done manually for relatively extensive keyword research. It will take a long time to decide whether a keyword is needed to be optimized. Based on these problems, this study aimed to analyze the implementation of the web scraping technique to get relevant keyword suggestions from the Google search engine and the number of "allintitle" that are owned automatically. The data used as an experiment in this test consists of ten keywords, which each keyword would generate a maximum of ten keywords suggestion. Therefore, from ten keywords, it will produce at most 100 keywords suggestions and the number of allintitles. Based on the evaluation result, we got an accuracy of 100%. It indicated that the technique could be applied to get keywords suggestions and allintitle from Google search engines with outstanding accuracy values.


automatic keyword suggestion; automatic allintitle; keyword research; Google search engine; web scraping

Full Text:



T. H. Sinaga, T. H. Sinaga, and E. Hadinata, “Implementasi Teknik Search Engine Optimization Dalam Meningkatkan Trafik Website Bima Utomo Waterpark,” Query J. Inf. Syst., vol. 3, no. 2, Oct. 2019.


M. Maskur, “Pengukur Parameter Search Engine Optimization (SEO) Secara On Page Pada Toko Online Untuk Meningkatkan Penjualan,” J. Adm. Dan Bisnis, vol. 13, no. 1, pp. 83–91, 2019.

A. Sofyan, E. Ferdianto, R. Rahmawati, and R. K. Aldi, “Pengaruh Search Engine Optimization (SEO) Dan Riset Kata Kunci Terhadap Pendapatan Toko Online,” in INCONTECSS, 2019, pp. 351–356.

A. I. Hadiana and E. K. Putra, “Model Search Engine Optimization bagi Usaha Mikro Kecil dan Menengah (UMKM) di Bandung Barat,” J. Masy. Inform. Unjani, vol. 2, no. 1, pp. 31–38, 2018.

S. N. Wahyuni and D. A. Wijaya, “Penerapan dan Optimasi Riset Keyword Dengan Teknik Allintitlle Pada Mesin Pencari Google,” J. Mantik Penusa, vol. 2, no. 2, pp. 40–44, 2018.

R. Fattahi, M. Parirokh, M. H. Dayyani, A. Khosravi, and M. Zareivenovel, “Effectiveness of Google keyword suggestion on users’ relevance judgment: A mixed method approach to query expansion,” Electron. Libr., vol. 34, no. 2, pp. 302–314, Apr. 2016, doi: 10.1108/EL-03-2015-0035.

M. I. Akrianto, A. D. Hartanto, and A. Priadana, “The Best Parameters to Select Instagram Account for Endorsement using Web Scraping,” in 2019 4th International Conference on Information Technology, Information Systems and Electrical Engineering (ICITISEE), 2019, pp. 40–45, doi: 10.1109/ICITISEE48480.2019.9004038.

A. Priadana and A. W. Murdiyanto, “Instagram Hashtag Trend Monitoring Using Web Scraping,” J. Pekommas, vol. 5, no. 1, p. 23, Apr. 2020, doi: 10.30818/jpkm.2020.2050103.

A. Priyanto and M. R. Ma’arif, “Implementasi Web Scrapping dan Text Mining untuk Akuisisi dan Kategorisasi Informasi dari Internet (Studi Kasus: Tutorial Hidroponik),” Indones. J. Inf. Syst., vol. 1, no. 1, pp. 25–33, Aug. 2018, doi: 10.24002/ijis.v1i1.1664.

D. J. Tandra, A. Noertjahyana, and A. N. Purbowo, “Implementasi Web Scraping untuk Pengumpulan Informasi Promo Makanan Menggunakan Klasifikasi Naïve Bayes,” J. Infra, vol. 8, no. 1, pp. 289–294, Apr. 2020.

D. D. A. Yani, H. S. Pratiwi, and H. Muhardi, “Implementasi Web Scraping untuk Pengambilan Data pada Situs Marketplace,” J. Sist. dan Teknol. Inf., vol. 7, no. 4, p. 257, Oct. 2019, doi: 10.26418/justin.v7i4.30930.

A. Pranav and S. Chauhan, “Efficient Focused Web Crawling Approach for Search Engine.” 2015.

S. Upadhyay, V. Pant, S. Bhasin, and M. K. Pattanshetti, “Articulating the construction of a web scraper for massive data extraction,” in Proceedings of the 2017 2nd IEEE International Conference on Electrical, Computer and Communication Technologies, ICECCT 2017, 2017, doi: 10.1109/ICECCT.2017.8117827.

C. Slamet, R. Andrian, D. S. Maylawati, S. Suhendar, W. Darmalaksana, and M. A. Ramdhani, “Web Scraping and Naïve Bayes Classification for Job Search Engine,” in IOP Conference Series: Materials Science and Engineering, 2018, pp. 1–7, doi:

A. K. Arsyad, B. Pramono, M. . Isnawaty S.Si., M. Yamin, and I. Sarita, “Implementasi Levenshtein Distance Pada Aplikasi Pencarian Barang Di Berbagai E-Marketplace Menggunakan Teknik Web Scraping,” Semin. Nas. APTIKOM 2019, vol. 0, no. 0, pp. 512–519, Nov. 2019.

R. C. Pereira and T. Vanitha, “Web Scraping of Social Networks,” Int. J. Innov. Res. Comput. Commun. Eng., vol. 3, no. 7, pp. 237–240, 2015. [18] Fatmasari, Y. N. Kunang, and S. D. Purnamasari, “Web Scraping Techniques to Collect Weather Data in South Sumatera,” in Proceedings of 2018 International Conference on Electrical Engineering and Computer Science, ICECOS 2018, 2019, doi: 10.1109/ICECOS.2018.8605202.

Article Metrics

Abstract view: 100 times
Download     : 40   times

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.


  • There are currently no refbacks.