130 likes | 230 Views
INDIA │ 18-20 august 2010. virtual techdays. SQL Data Loading Techniques. Praveen Srivatsa │ Director, AsthraSoft Consulting Microsoft Regional Director, Bangalore MVP, ASP.NET. INDIA │ 18-20 august 2010. virtual techdays. Replication Choices Managing Replication
E N D
INDIA │ 18-20 august2010 virtual techdays SQL Data Loading Techniques Praveen Srivatsa│ Director, AsthraSoft Consulting Microsoft Regional Director, Bangalore MVP, ASP.NET
INDIA │ 18-20 august2010 virtual techdays • Replication Choices • Managing Replication • Syncing up replication S E S S I O N A G E N D A
Overview • Tools and functionality in SQL Server for: • Data transport out of the database • Data transport into the database • Tools and functionality in SQL Server for data transport into, out of, and within a database and across multiple databases, multiple file formats, and other data sources and destinations
Data Out Overview SQL Server ToolsSQL Server Integration Services (SSIS) BCP Sqlcmd.exe PowerShell SELECT or PRINT Linked Servers SQL Server 2008
Data In Overview SQL Server ToolsSQL Server Integration Services (SSIS) BCP Bulk Insert Sqlcmd.exe PowerShell SELECT INTO Linked Servers SQL Server 2008
SQL Server Data Transport • SQL Server offers several Bulk Copy commands and tools: • BCP, the Bulk Copy utility, is used to transfer large volumes of data in and out of a database • To export—data is dumped into a flat file in a delimited format • To import—data is first exported from the source database or program and then imported into SQL Server database • BULK INSERT command can be used within Transact-SQL programs to insert large volumes of data from a flat file • Bulk copy API can be used in ODBC, OLE DB, SQL-DMO and SMO applications • OPENROWSET (BULK…) can also be used to bulk import large object data in SQL Server
SQL Server Integration Services (SSIS) • SQL Server Integration Services offers several tools to extract, transform and load data from multiple data sources into SQL Server databases and vice versa • Provides control over data flow, looping and conditioning • Packages can be built using • SSIS designer in Business Intelligence Development Studio • Import / Export Wizard • Database Export Utility
Elements of Integration Services • SQL Server Integration Services Service (MsDtsSrvr.exe) • Package • Control Flow Elements • Containers • Tasks • Precedence Constraints • Data Flow Elements • Event Handlers • Variables • Configurations
SSIS Tools • SSIS tools are used to create, modify and execute Packages • SSIS Import / Export Wizard • Assists in building simple Packages to import, export, and transform data or to copy database objects • SSIS Designer inside Business Intelligence Development Studio • Graphical application that lets us build and debug packages containing complex workflows, multiple connections to heterogeneous data sources, and event-driven logic • SSIS Package Execution Utilities • dtexecui.exe • dtexec.exe • dtutil.exe is a tool used to manage SSIS packages
Review • We reviewed tools used in Oracle for transferring data out of a database — Data Pump Export utility, SQL*Plus, SBMS_UTILITY and UTL_FILE packages and their SQL Server equivalents — bcp utility, sqlcmd.exe tool, SSIS, print and SELECT statements • We have seen tools used in Oracle for transferring data into a database — Data Pump Import utility, SQL*Plus, SQL*Loader and command, SSIS, OPENROWSET • We discussed in detail the Bulk Copy commands in SQL Server • We discussed SSIS in detail, including: • SSIS Package components such as tasks, transformations and workflow constraints • SSIS tools such as Import//Export Wizard, SSIS Designer • Copy Database Wizard
THANKS│18-20 august2010 virtual techdays praveens@asthra.net│ asthratimes.asthrasoft.com