DOM and Visual Clues for Extracting Structured data from Web
Abstract & Details
Research Area
Computer Engineering
Keywords
Data extraction
Structure data
Web mining
Structured Data Extraction
Visual Clues
DOM tree
Web data mining
Web data extraction
Visual features for web pages
Abstract
This paper studies the problem of extracting data from a Web Page that contains several structured data records. The objective is to segment these data records, extract data items/fields from them and put the data in a database table. This paper proposes a new Method to perform the task automatically. It consists of two steps, (1) Identifying individual data records in a web page, and (2) Aligning and extracting data items from the identified data records. For Step 1, we propose a novel Document Object Model (DOM Trees). A technique based on tree matching. Removal of noise blocks is made from DOM trees. For step 2, we propose a method based on Visual Clues information Segment data records, which is more accurate than existing Methods. In this paper defines a new approach which has removed LRU (Least Recently Used) web pages. This approach enables very accurate Alignment of multiple data records and removes unwanted web pages which is don’t use for the longest time. Experimental results using a large number of Web pages from diverse domains show that the proposed two-step technique is able to segment data records, align and extract data from them very accurately.
License
This work is licensed under a Creative
Commons
Attribution-ShareAlike 4.0 International License.
Author Information
| # | Name | Institute / Affiliation |
|---|---|---|
| 1 | Pathik B Shah | Silver Oak College of Engineering & Technology |
| 2 | Assi. Prof. Hiren J Patel | Silver Oak College of Engineering & Technology |
How to Cite
Use the following formats to cite this article in your research.
APA Style
Shah, Pathik B & Patel, Assi. Prof. Hiren J (2016). DOM and Visual Clues for Extracting Structured data from Web. International Journal of Advance Research and Innovative Ideas In Education, 2(3), 1095-1101.
MLA Style
Shah, Pathik B, and Assi. Prof. Hiren J Patel. "DOM and Visual Clues for Extracting Structured data from Web." International Journal of Advance Research and Innovative Ideas In Education, vol. 2, no. 3, 2016, pp. 1095-1101.
IEEE Style
Pathik B Shah and Assi. Prof. Hiren J Patel, "DOM and Visual Clues for Extracting Structured data from Web," International Journal of Advance Research and Innovative Ideas In Education, vol. 2, no. 3, pp. 1095-1101, 2016.
Vancouver Style
Shah Pathik B, Patel Assi. Prof. Hiren J. DOM and Visual Clues for Extracting Structured data from Web. International Journal of Advance Research and Innovative Ideas In Education. 2016;2(3):1095-1101.
Harvard Style
Shah, Pathik B & Patel, Assi. Prof. Hiren J (2016) 'DOM and Visual Clues for Extracting Structured data from Web', International Journal of Advance Research and Innovative Ideas In Education, 2(3), pp. 1095-1101.
Chicago Style
Shah, Pathik B and Assi. Prof. Hiren J Patel. "DOM and Visual Clues for Extracting Structured data from Web." International Journal of Advance Research and Innovative Ideas In Education 2, no. 3 (2016): 1095-1101.
Turabian Style
Shah, Pathik B and Assi. Prof. Hiren J Patel. "DOM and Visual Clues for Extracting Structured data from Web." International Journal of Advance Research and Innovative Ideas In Education 2, no. 3 (2016): 1095-1101.
Related Research
Comprehensive Review of Existing Chatbot Systems for Career Assistance, Resume Support, and ATS-Aware Guidance
PDF Unavailable
Development of an AI-Powered Multimodal Web Assistant with Intelligent Resume Building and ATS Enhancement
PDF Unavailable
A Deep Learning-Based Framework for Mood-Oriented Music Recommendation Using Facial Expression Analysis
PDF Unavailable
Survey On : Intelligent Payroll and Human Resource Management Systems: A Systematic Review of Automation, Security, and Analytics
PDF Unavailable
Civic Engagement & Empowerment Platform
PDF Unavailable
Recent Developments in Microneedle Technology and Its Diverse Biomedical Applications
PDF Unavailable
RAG System Development with Pydantic AI ChromaDB & Groq
PDF Unavailable
Machine Learning Based Early Stage Diabetes Detection System
PDF Unavailable
A Survey on Skillsense:AI Career Analyzer App
PDF Unavailable
Employee Performance Portal
PDF Unavailable