1 / 14

Best Practices of ETL Processes Controlling Research Issues

This research paper discusses the best practices in controlling ETL (Extract, Transform, Load) processes for managing research issues in areas such as agents, ontology, knowledge management, data management, and software engineering.

judkins
Download Presentation

Best Practices of ETL Processes Controlling Research Issues

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. ISLAB Trend CEIT.AUT.AC.IR/ISLAB best practices of ETL processes controlling

  2. Research Issues • Agents (Multi-Agent Systems) • Ontology • Knowledge Management • Data Management • Software Engineering best practices of ETL processes controlling

  3. Research Issues • Multi-agent systems • Agent-based Software Engineering • Automated Negotiation • Ontology Learning • Flexible Inference Engine • Knowledge Validation and Verification • Search Engines and Focused Crawlers • Data Mining • Data Warehousing • Active Database systems • Scheduling Active Rules in Active Database Systems • Geographical Data Warehousing • Web Mining • Semantic Web Mining • Text Mining • Software Architecture • Natural Language Processing best practices of ETL processes controlling

  4. Software Engineering • p. Jaferian, A. Abdollahzadeh, "AES-AKU: A Framework for Comparing and Selecting Software Architecture Evaluation Methods," 11th International CSI Computer Conference, Jan 2006, Tehran, Iran • V. Hakami, A. Abdollahzadeh, "Product-Focused Process Elicitation for Mobile Application Systems:A Wireless News Browser Case," The 9th IASTED International Conference on Software Engineering and Applications, Nov 2005, Phoenix, USA. • Sh. Vafadar, A. Abdollahzadeh Barforoush, “A Framework for Dynamic Planner Agents in Unknown Environment”, 10 Annual Computer Society of   Iran Computer Conference (CSICC'2005), Feb 15-17, 2005, Tehran, Iran • Sh. Vafadar, A. Abdollahzadeh, "Ex-MaSE: An Extended Methodology for Analysis and Design of Agent-based Systems", In proceedings of 9th Annual Computer Society of    Iran Computer Conference (CSICC'2004), Tehran, Iran, February 2004. • B. Moradi shokro, A. Abdollahzadeh, S. Katebi, "A suitable approach for selecting a practical methodology in system analysis", CIS 2003, Mashad, 2003. • A. Abdollahzadeh, A. Tohidi, B. Moradi shokro, "MAS-UML: A language for Modeling MAS", CIS 2003, Mashad, 2003. • A. Abdollahzadeh, S. Vafadar, "Ex-MaSE: An Extended and Expressive Multiagent System Engineeing", Arab Conference on Information Technology (ACIT’2003), Egypt-Alexandria, 2003. • R. Nasiri, A. Abdollahzadeh, A. Moeini, “A New Approach Towards Mature Software Models through Business to Software Unified Process (BSUP)”, IKE’03, Jun 23-26, 2003, Las Vegas, Nevada, USA • S. Vafadar, A. Abdollahzadeh, M.R. A. Shirazi, "Bridging the Gaps in the MaSE Methodology", ATS 2003, University of calagury, 2003. • S. Vafadar, Ahmad Abdollahzadeh, M.R. A. Shirazi, A. "Improving the MaSE Methodology: A case study", 8th Annual Computer Society of Iran Computer Conference, Mashad, Iran, 2003. • R. Nasiri, A. Abdollahzadeh, A. Moeini, “A New Approach Towards Procurement of Software Models Via Distributed Business”, Journal of SuperComputer, USA, Sep 2004 • A. Abdollahzadeh, Sh Vafadar, “Towards a More Expressive and Refinable Multiagent System Engineering”, Journal of Lecture Notes in Computer Science, Germany, 2004. (12 Conference Papers) (2 Journal Papers) best practices of ETL processes controlling

  5. Web Mining • Zh. Safikhani, A. Abdollahzadeh, "Design of  SPAM: A Tool for Mining in World Wide Web," 11th International CSI Computer Conference, Jan 2006, Tehran, Iran. • A. Abdollahzadeh, Gh. Kheradmandian, " Conceptual Classification of Web Pages Using  Context Information and Links Between Web Pages," 11th International CSI Computer Conference, Jan 2006, Tehran, Iran • H.R. Mottahari Nezhad, A. Abdollahzadeh, "Using Support Vector Machines Classifier to Improve Performance of  Reinforcement Learning based Web Crawlers", In proceedings of 9th Annual Computer Society of Iran Computer Conference (CSICC'2004),Tehran, Iran, February 2004. • A. Abdollahzadeh, H.R. Motaharynezhad, "The comparison of Support Vector Machines Classifer and Na?e Bayes Classifer in Reinforcement Learning Based Crawlers", Arab Conference on Information Technology (ACIT’2003), Egypt-Alexandria 2003. • H.R. Motaharynezhad, A. Abdollahzadeh, "Expanding Reinforcement learning approaches in efficient crawling of the Web", The 7th world Multi Conference on Cybernetics Systematics and informatics, Florida, USA, 2003. • H.R. Motaharynezhad, A. Abdollahzadeh, "A New Approach to Expand User`s Query in Doman Specific Search Engines", 8th Annual International CSI (CSICC’2003), Ferdowsi University of Mashhad, Iran, 2003. • A. Abdollahzadeh, H.R. Motaharynezhad, "A Case-based Reasening Framework for Domain Specific Search Engines", ACIT 2002, the first Arab Conference on Information Technology, Dec 16-19, 2002, Doha- Qatar • H. Motahari Nezhad, A. Abdollahzadeh, “Centralized Search Engine: New Approach for Search Engines with Specific Domain”, In proceeding of the student  Computer Conference,Dec 2002, Mashhad, Iran. • A. Abdollahzadeh, H.R. Motaharynezhad,"A New Approach to Information Retrieval based on Case-based Reasoning and concept hierarchy in cora", Data Mining 2002, Third International Conference on Data Mining Methods for Engineering and Finance and other fields, Sep 25-27, 2002,  Bologna-Italy • A. Abdollahzadeh, D. Perlis, H.R. Motaharynezhad, M.O. Anderson, "ALII: An Information Integration Enuironment based on Active Logic Framework", MIS 2002 Third Int. Conference on Management Information Systems, Apr 24-26, 2002, Halkidiki, Greece. • A. Abdollahzadeh, H.R. Motahari Nezhad, “A Case Based Reasoning Approaches to Domain Specific Search Engines”, Int. Journal of Applied Science and Technology, USA, Aug 2003. • A. Abdollahzadeh, H.R. Motaharynezhad, "AKU Search Engine: An Architecture for Focused Crawling Search Engines", Journal of Amirkabir University, Tehran, Iran, 2003. (10 Conference Papers) (2 Journal Papers) best practices of ETL processes controlling

  6. Data Management • A. Rasoulzadegan, R. Alesheikh, A. Abdollahzadeh, "A new approach for Event Triggering Probability Estimation in Active Database Systems to improve Rule Scheduling," 11th International CSI Computer Conference, Jan 2006, Tehran, Iran. • M. Sargolzaei, A. Abdollahzade, "Design of  Structural Data Cube for Geographical Data warehouse Implementation," Student Conference in Computer Engineering JDIOC, June 2005, Tehran, Iran. • M. Sargolzaei, A. Abdollahzade, "Implementation of Conceptual Multidimention Model to Support Spatial Analysis," Student Conference in Computer Engineering JDIOC, June 2005, Tehran, Iran. • Rohollah Alesheykh, A. Abdollahzadeh, "Evaluation and Comparison of Rule Scheduling Approaches in Active Database Systems", In Proceedings of the 2nd IASTED international Multi-Conference on Automation, Control, and Information Technology (ACIT’05), June 20-24, 2005, Novosibrisk, Russia • H. Heidarian Shahri, A. Abdollahzadeh Barforoush, “A New Cleansing Method for Data Warehouse Creation”, 10 Annual Computer Society of   Iran Computer Conference (CSICC'2005), Feb 15-17 2005, Tehran, Iran • M.R. Rahaimehr, A. Abdollahzadeh Barforoush, “Solving the Problems of Deadlock in Transactions Using Fuzzy Techniques   ”, 10 Annual Computer Society of   Iran Computer Conference (CSICC'2005), Feb 15-17, 2005, Tehran, Iran. • R. Alesheikh, A. Abdollahzadeh Barforoush, “An Effective Rule Selection Approach for Rule Scheduling in Active Database Systems”, 10 Annual Computer Society of   Iran Computer Conference (CSICC'2005), Feb 15-17, 2005, Tehran, Iran. • R. Alesheikh, A. Abdollahzadeh Barforoush, “Evaluation Methodology for rule scheduling in Active Database Systems”, International Conference on Computational Intelligence (ICCI’2004), Dec 17-19, 2004, Istanbul- Turkey • N. Daneshpour, A. Abdollahzadeh Barforoush, “A New Approch Toward Refreshing Data warehouse”, ”, International Conference on Computational Intelligence (ICCI’2004), Dec 17-19, 2004, Istanbul- Turkey. • H. Haidarin Shahri , A. Abdolahzdeh, “The Effect of Membership Function Shape in Approximate Duplicate Elimination”, ICCTA 2004, Sep 28-30, 2004, Egypt. • H. Haidarian Shahri , A. Abdolahzdeh, “A Flexible Fuzzy Expert System for Fuzzy Duplicate Elimination in Data Cleaning”, DEXA 2004, Aug 30, 2004, Spain. • H. Heidarian Shiri, A. Abdollahzadeh, “Data Mining for Removing Fuzzy Duplicates Using Fuzzy Inference”, NAFIPS 2004, Jun 23-30, 2004, Banff, Alberta, Canada. • N. Daneshpour, Ahmad Abdollahzadeh, M.R. A. Shirazi, A. "A New approach for updating Data Warehouse", 8th Annual Computer Society of Iran Computer Conference, Mashad, Iran, 2003 • A. Abdollahzadeh, H. Heidarian Shahri, “A Flexible Fuzzy Expert System for Fuzzy Duplicate Elimination in Data Cleaning”,  Journal of Lecture Notes in Computer Science, Germany, 2004 • A. Abdollahzadeh, N. Hajiheidari, " Study of Problems of Information Systems Strategic Scheduling in Iran in Experts point of view," Journal of Management Knowledge, Iran (13 Conference Papers) (2 Journal Papers) best practices of ETL processes controlling

  7. Knowledge Management • P. Jaferian, A. Abdollahzadeh, "AES-AKU: A Framework for Comparing and Selecting Software Architecture Evaluation Methods," 11th International CSI Computer Conference, Jan 2006, Tehran, Iran • A. Abdollahzadeh, F. Dadras, "Knowledge Representation: A New Approach in Architecture of Information Systems," 8th Conference of  Librarians of Management and Planning Organization, Dec 2005, Isfahan, Iran. • A. Abdollahzadeh Barforoush, Mirzababai, “A New Intelligent Operating System Design”, International Conference on Computational Intelligence (ICCI’2004), Dec 17-19, 2004, Istanbul- Turkey • A. Abdollahzadeh, Mirzababai, “A New Design for Inter-Process Communications in the Intelligent Operating Systems”, ICT2004, Nov 18-19, 2004, Thailand, assumption university. • H. Haidarin Shahri , A. Abdolahzdeh, “The Effect of Membership Function Shape in Approximate Duplicate Elimination”, ICCTA 2004, Sep 28-30, 2004, Egypt. • A. Abdollahzadeh Barfouroush, Ch. Dadkhah, “OAV-VVT Expert,An active system for Verification and Validation of Knowledge Base Based on Ex-OAV KB”, ICSE & INCOSE 2004 CONFERENCE, Sep 15-18, 2004, Las Vegas, Nevada, USA. • H. Haidarian Shahri , A. Abdolahzdeh, “A Flexible Fuzzy Expert System for Fuzzy Duplicate Elimination in Data Cleaning”, DEXA 2004, Aug 30, 2004, Spain. • A. Abdollahzadeh, F. Dadras, "Meta-Lexicon: A new approach in Knowledge Representation",CIS 2003, Mashad, 2003. • M. Shamsfard, Ahmad Abdollahzadeh, "Extracting Conceptual Knowledge from text: Using linguistic semantic Templates", 2nd International conference on conegtive science, tehran, Iran, 2003 • A. Abdollahzadeh, H.R. Motaharynezhad, "A Case-based Reasening Framework for Domain Specific Search Engines", ACIT 2002, the first Arab Conference on Information Technology, Dec 16-19, 2002, Doha- Qatar • M. Shokri, A. Abdollahzadeh, “Knowledge Engineering Methods and Learning Systems for Designing Text Mining Systems”,4th Student Conference of Computer Society of Iran , Sep 3-5, 2002, Najafabad, Iran. • A. Abdollahzadeh, S. Matloubi, “MSA- The Multimedia Training Structure”, 5th Iranian Mathematics Education Conference, Jan 27-29, 2001, Mashhad, Iran • A. Abdollahzadeh, R. Asgarabadi, “Adhoc User Interface for Information Systems”, In Proceeding of 6th Annual Conference, 2000 • S. Pourazin, A. abdollahzadeh, “FLEng, the Flexible Inference Engine”, 18th IASTED International Conference in Applied Information, AI2000, Innsbruck, Austria, 2000. best practices of ETL processes controlling

  8. Knowledge Management • Ch. Dadkhah, A. Abdollahzadeh,  “Input Knowledge Representation In Decision Support Systems ”,5th Annual International CSI Computer Conference(CSICC’2000), Mar 7-9, 2000 ,Shahid Beheshti University Tehran, Iran. • A. Abdollahzadeh, Sh. Pourazin, M. Shamsfar, “A Design for Knowledge Partitioning: Introduction an Intermediate Reflective Model”, In proceedings of 4th Annual International CSI (Computer society of Iran) Computer Conference (CSICC’98), Jan 26-28, 1999, Tehran, Iran. • S.M. Mirzababaei, A. Abdollahzadeh, "A Novel Design for the Intelligent Operating System," International Journal of Computational Intelligence-IJCI, 2004. • Sh. Purazin, A.Abdollahzadeh, "Going Meta: Back to the Expectations", Scientific Journal of Science and Computer Eng, Iran • Sh. Purazin, A. Abdollahzadeh, “Concurrent Metareasoning”, Journal of SuperComputer, vol. 34, pp.1-14, 2005 • A.Abdollahzadeh, Ch. Dadkhah, "QAV-VVT expert, an active System for Verification and Validation of Knowledge Base Using QAV Knowledge Representation," Scientific Journal of Science and Computer Eng, Iran, 2004. • A. Abdollahzadeh, M. Shami, "Presenting needed infrastructure testbeds for IT& Communication", Management Knowledge Magazine, Iran, 2001. • M. shamsfard, A. Abdollahzadeh, "Mining Conceptual Knowledge from Brain Using Lingual and Semantic Patterns," Advances in Cognitive Science, Iran, 1(4); 2001. • A. Abdollahzadeh, S. Pourazin, M. Shamsfard, "Relation between inference syntax and Knowledge Representation", Journal Amirkabir University, Tehran, Iran, 2000. (16 Conference Papers) (7 Journal Papers) best practices of ETL processes controlling

  9. Agents -1 • M. Maleki, S. Soltani, L. Jalali, A. Abdolahzadeh, "Dynamic Strategies in Architecture of SiMiLa Trading Agent," 11th International CSI Computer Conference, Jan 2006, Tehran, Iran. • A.A. Jamshidifar, A. Afshar, A. Abdollahzadeh, "Agent-Based Modeling and Optimization of Gas Transmission Network," 11th IEEE International Conference on Methods in Automation and Robotics, Aug-Sep 2005, Miedzyzdroje, Poland • Mirzababaei, A Abdollahzadeh, “A Multiagent System As An Intelligent Operating System”, The 2005 International Conference on Parallel and Distributed Processing Techniques and Application (PDPTA’5), June 27-30, 2005, Las Vegas, Nevada, USA • A.abdollahzadeh, Mirzababai, “A Multiagent System for the Resource Management”, Automation, Control and Applications  (ACI –ACA 2005), June 20-24, 2005, Novosibirsk, Russia • Sh. Vafadar, A. Abdollahzadeh Barforoush, “A Framework for Dynamic Planner Agents in Unknown Environment”, 10 Annual Computer Society of   Iran Computer Conference (CSICC'2005), Feb 15-17, 2005, Tehran, Iran • A. abdollahzadeh Barforoush, M.R. Ayatollahzadeh Shirazi, “Formulating Flexibility in Automated Negotiation Systems”, International Conference on Computational Intelligence (ICCI’2004), Dec 17-19, 2004, Istanbul- Turkey • Abdollahzadeh Barfouroush, A., Ayatollahzadeh Shirazi, M. R.,” A New Perspective on Agent-Oriented Software Engineering”, In Proceedings of 5th International Symposium on Intelligent Automation and Control (ISIAC 2004), World Automation Congress (WAC), July 2004, Seville,Spain,. • S. Ghanbari, A. Abdollahzadeh, "Load Balancing in Peer-to-Peer Computing based on a Society of Autonomous Agents", Poster Paper, In proceedings of 9th Annual Computer Society of Iran Computer Conference (CSICC'2004), Tehran, Iran, February 2004. • H. Haydarian Shahri, A. Abdollahzadeh, "Agent Architecture and Cooperation Protocol for an Episodic and Inaccessible Environment", Poster Paper, In proceedings of 9th Annual Computer Society of Iran Computer Conference (CSICC'2004),Tehran, Iran, February 2004. • R. Alesheykh, A. Abdollahzadeh, "Design and Evaluation of an Extendible Architecture for Javelin++ based on Negotiating Agents",In proceedings of 9th Annual Computer Society of  Iran Computer Conference (CSICC'2004, Tehran, Iran, February 2004. • Sh. Vafadar, A. Abdollahzadeh, "Ex-MaSE: An Extended Methodology for Analysis and Design of Agent-based Systems", In proceedings of 9th Annual Computer Society of    Iran Computer Conference (CSICC'2004), Tehran, Iran, February 2004. • A. Abdollahzadeh, A. Tohidi, B. Moradi shokro, "MAS-UML: A language for Modeling MAS", CIS 2003, Mashad, 2003. • A. Abdollahzadeh, A. Ghadamiari, "Designing and Validation of a multi-parameter Negotition Algorithm in E-Commerce multi agent system", IKT 2003, Tehran, Iran. • A. Abdollahzadeh, S. Vafadar, "Ex-MaSE: An Extended and Expressive Multiagent System Engineeing", Arab Conference on Information Technology (ACIT’2003), Egypt-Alexandria, 2003. • A. Abdollahzadeh, M.R. A. Shirazi, "Tool Assessment for Agent-based Development", Arab Conference on Information Technology (ACIT’2003), Egypt-Alexandria, 2003. • Vafadar, S.,  A. Abdollahzadeh Barfoufoush, Ayatollahzadeh Shirazi, Mohammad Reza: “Towards a more Expressive and Refinable Multiagent Software Engineering Methodology”, In  P. Giorgini, B. Henderson-Sellers, and M. Winikoff (Eds.)  Agent-Oriented Information Systems - Lecture Notes in AI (LNAI 3030), 5th International bi-conference workshop on Agent-Oriented Information Systems (AOIS 2003), Springer-Verlag, July 2003, Melbourne, Australia, Chicago October 2003 best practices of ETL processes controlling

  10. Agents -2 •  M.R. A. Shirazi, A. Abdollahzadeh, "Dicision Criteria for Tool Selection in Agent-based Development", 8th Annual International CSI (CSICC’2003), Ferdowsi University of Mashhad, Iran, 2003. • M.R. A. Shirazi, A. Abdollahzadeh, "Agent-based Software Engineering as a Layered Technology", Proceedings of Agents for Information Management Workshop (AIM 2002), EurAsia-ICT 2002 AIM Workshop Shiraz, Iran, 2002. • A. Abdollahzadeh, Sh Vafadar, “Towards a More Expressive and Refinable Multiagent System Engineering”, Journal of Lecture Notes in Computer Science, Germany, 2004 (18 Conference Papers) (1 Journal Papers) best practices of ETL processes controlling

  11. Ontology • A. Abdollahzadeh, Gh. Kheradmandian, " A Query Process System Based on Ontology for Question answering," 11th International CSI Computer Conference, Jan 2006, Tehran, Iran. • M. Shamsfard , A. Abdollahzadeh, "A Framework for Comparison and Evaluation of Learning  Ontology Systems", In proceedings of 9th Annual Computer Society of Iran Computer Conference (CSICC'2004),Tehran, Iran, February 2004. • M. Shamsfard, Ahmad Abdollahzadeh, "Extracting Conceptual Knowledge from text: Using linguistic semantic Templates", 2nd International conference on conegtive science, tehran, Iran, 2003 • M. Shamsfard, Ahmad Abdollahzadeh,"Creating Onthology from Natural languages texts", 8th Annual Computer Society of Iran Computer Conference, Mashad, Iran, 2003 • M. Shamsfard, A. Abdollahzadeh, "An Introduction to Hasti: An Ontology Learning System", International Conference on Artificial Intelligence and Soft Computing (ASC`-2), Jul 17-19, 2002, Banff-Canada. • M. Shamsfar, A. abdollahzadeh, “A Basis for Evolutionary Ontology Construction”, 18th IASTED International Conference in Applied Information, AI2000, Innsbruck, Austria, 2000 • A. Abdollahzadeh, M. Shamsfard, "HASTI: A Base for Evolutionary Ontology Construction to Natural Language Understanding" 9th Iranian Conference on Electrical Engineering 17-19 May 1999, Iran. • M. Shamsfard, A.Abdollahzadeh, “The State of the art in ontology learning: A Framework to Compare”, Knowledge Engineering Review Journal, UK, Aug 2004. • M. Shamsfard, A. Abdollahzadeh, "Learning Ontologies from Natural language Texts", To apear in Int. Journal of Human- Computer Studies, UK ISI, Jan 2004. • A. Abdollahzadeh, M. Shamsfard, "Computational Lexicon: Centeral organization in NLP systems", Journal of Amirkabir University, Tehran, Iran, 2001 • M. shamsfard, A. Abdollahzadeh, "Mining Conceptual Knowledge from Brain Using Lingual and Semantic Patterns," Advances in Cognitive Science, Iran, 1(4); 2001. (7 Conference Papers) (4 Journal Papers) best practices of ETL processes controlling

  12. Papers Knowledge Management Web Mining ontology Data Management Software Engineering Agents best practices of ETL processes controlling

  13. Students • Multi-agent systems (4Msc+1Phd) • Agent-based Software Engineering(1Msc+1Phd) • Automated Negotiation(1Phd) • Ontology Learning(3Msc+1Phd) • Knowledge Validation and Verification(3Msc+1Phd) • Search Engines and Focused Crawlers(3Msc) • Data Mining(4Msc+1Phd) • Data Warehousing(3Msc+1Phd) • Active Database systems(2Msc+1Phd) • Geographical Data Warehousing(1Msc) • Web Mining(5Msc) • Text Mining(2Msc) • Software Architecture (3Msc+1Phd) • Natural Language Processing(2Msc) best practices of ETL processes controlling

  14. Students Knowledge Management Web Mining ontology Data Management Software Engineering Agents best practices of ETL processes controlling

More Related