Database for Web Applications

1. DatabaseforWeb Applications Yingcai Xiao

2. Introduction to Web Applications

3. DBMS / Database Server Application Server WEB S E R V E R WEB C L I E N T Supporting Software App User Interface (V) User Interface Application Logic (C) Database Engine Database Database API (M) Architecture of a Four-Tier Web Application Architecture of a Four-Tier Web Application

4. Introduction to Database

5. Definitions • Computer Science:the science of data processing using a computational device. • Database (DB): a persistent store of data in a compact, secure, easy-and-fast-to-retrieve form. • Database Engine: a software program that creates and manages databases. (e.g. MS Jet Engine) • Database Management System (DBMS): a database engine plus user interfaces and other supporting software. • DBMS Examples: Oracle, DB2 (IBM), Sybase, Informix, Microsoft SQL Server, Microsoft Access, MySQL (public domain), … • Database Server: a DBMS that provides data to its remote clients. .

6. DBMS Example: SQL Server • By Microsoft • Needs runtime license • Best fit for .NET • Features http://www.microsoft.com/sql/prodinfo/features/top30features.mspx • Available in MSDNAA. http://www.cs.uakron.edu/~xiao/msdnaa.html • Free-for-all version: SQL Server Express http://www.microsoft.com/sql/editions/express/default.mspx

7. DBMS Example: MySQL • By MySQL AB (part of Sun after 1/16/08. Sun has been merged into Oracle.) • Free: http://dev.mysql.com/ • No need of runtime license • Not the best fit for .NET

8. MySQL on db1.cs.uakron.edu • MySQL is used for the following classes: Windows Programming, Internet System Programming, Introduction to Database, Data Mining, and Data Integration. • It has been installed on db1.cs.uakron.edu • To use it, follow the instructions at http://www.cs.uakron.edu/~xiao/windows/4T-App-Deployment.html • To install it at home, follow the instructions at http://www.cs.uakron.edu/~xiao/windows/MySQL-Installation.html

9. Data Format in the Database • Database Table: data are stored in a database as “tables”. Each row of a table is called a record, each column of a table is called an attribute. Each needs to have a “key” attribute(s). Each record needs to have a unique key value. PhoneBook (Database Table Name) • Database schema: meta data for databases, defining tables and their attributes.

10. Database Schema, Language, API • Database schema: meta data for databases, defining tables and their attributes. (UDT, like classes) • SQL (Structured Query Language): the de facto standard language for database. • Database API: application programming interface to DBMSs.

11. SQL • SQL: Structured Query Language, a standardized language for accessing and manipulating databases. • The Select-From-Where Clause: Select Office From PhoneBook Where Name=’Tom’; Select * From PhoneBook; • Three Parts of SQL: • Query: data retrieval • DML - Data Manipulation Language: inserting, deleting, updating, … • DDL - Data Definition Language: table creation, alteration and drop.

12. SQL Example CREATE DATABASE pubs; USE pubs; CREATE TABLE authors ( au_id varchar(11) NOT NULL, au_lname varchar(40) NOT NULL, au_fname varchar(20) NOT NULL, phone char(12) NOT NULL DEFAULT 'UNKNOWN', address varchar(40) NULL, city varchar(20) NULL, state char(2) NULL, zip char(5) NULL, contract bit NOT NULL, PRIMARY KEY(au_id) );

13. SQL Example insert authors values('409-56-7008', 'Bennet', 'Abraham', '415 658-9932', '6223 Bateman St.', 'Berkeley', 'CA', '94705', 1); insert authors values('213-46-8915', 'Green', 'Marjorie', '415 986-7020', '309 63rd St. #411', 'Oakland', 'CA', '94618', 1);

14. Server-SideDatabase Programming

15. DBMS / Database Server Application Server WEB S E R V E R WEB C L I E N T Supporting Software App User Interface (V) User Interface Application Logic (C) Database Engine Database Database API (M) Architecture of a Four-Tier Web Application Architecture of a Four-Tier Web Application

16. Pattern of database programming • Create a connection object. • Open the connection. • Create a command object. • Execute the command. • Access the data. • Close the connection.

17. Server-SideDatabase Programming Languages

18. Database Programming Languages PHP JSP / Servlet ASP.NET Roby on Rails

19. Database Programmingwith PHP:C13 of Sebesta’s Programming WWW.

20. PHP DB Programming https://www.php.net/ https://www.w3schools.com/php/default.asp Programming PHP https://www.php.net/manual/en/features.commandline.webserver.php Examples (needs to be on UA VPN) http://www.cs.uakron.edu/~xiao/isp/PHP-HowTo.html http://pausch.cs.uakron.edu/~xiao/php/db-starter.html

21. Database Programmingwith JSP:C13 of Sebesta’s Programming WWW.

22. JSP DB Programming JavaServer Page (JSP) Introduction How to Run JSP Programs on the Lab Computers Java Web Server Setup JSP Examples(needs to be on UA VPN) http://pausch.cs.uakron.edu:8080/xiao/cars.jsp https://www.tutorialspoint.com/jsp/ Java Web Application Server Setup http://java.sun.com/products/jsp/jstl/ http://java.sun.com/j2ee/

23. Database Programmingwith ASP.NET:C13 of Sebesta’s Programming WWW.

24. Microsoft ADO .NET ADO.NET is the database API for managed applications (application servers) to talk to database servers (DBMS: Database Management Systems). • a database API for managed applications; • a set of classes in .NET FCL System.Data namespace; • designed to work over the Web; • integrates effortlessly with XML; • maps very well to stateless, text-based protocol HTTP; • accesses databases through modules known as data providers ( a set of APIs that make the accesses easy to program).

25. Two Data Providers • The SQL Server .NET provider • interfaces to Microsoft SQL Server (7.0 or later) • all managed code • code runs faster • code not portable to other databases • The OLE DB .NET provider • OLE: Object Linking and Imbedding • interfaces to databases through unmanaged OLE DB providers: SQLOLEDB for SQL Server (6.5 or earlier), MSDAORA for Oracle and Microsoft, Jet.OLEDB.4.0 for Microsoft Jet database engine. • code runs slower • code portable to other databases

26. The System.Data.SqlClient and System.Data.OleDb Namespaces Classes in System.Data.SqlClient are for SQL Server .NET using System.Data.SqlClient; SqlConnection conn = new SqlConnection ("server=localhost;database=pubs;uid=sa;pwd="); try { conn.Open (); SqlCommand cmd = new SqlCommand ("select * from titles", conn); SqlDataReader reader = cmd.ExecuteReader (); while (reader.Read ()) Console.WriteLine (reader["title"]); } catch (SqlException ex) { Console.WriteLine (ex.Message); } finally { conn.Close (); }

27. The System.Data.SqlClient and System.Data.OleDb Namespaces Classes in System.Data.OleDb are for OLE DB .NET using System.Data.OleDb; OleDbConnection conn = new OleDbConnection("provider=sqloledb;server=localhost;database=pubs;uid=sa;pwd="); try { conn.Open (); OleDbCommand cmd = new OleDbCommand ("select * from titles", conn); OleDbDataReader reader = cmd.ExecuteReader (); while (reader.Read ()) Console.WriteLine (reader["title"]); } catch (OleDbException ex) { Console.WriteLine (ex.Message); } finally { conn.Close (); }

28. Pattern of database programming • Create a connection object. • Open the connection.

29. Connection Objects The SqlConnection Class The ConnectionString SqlConnection conn = new SqlConnection (); conn.ConnectionString = "server=localhost;database=pubs;uid=sa;pwd="; or SqlConnection conn = new SqlConnection ("server=localhost;database=pubs;uid=sa;pwd="); Errors in the connection string only throws exceptions at runtime.

30. Server Server Server=localhost or Server=(local) or Data Source=(local) SQL Server permits different instances of servers to be installed on a given machine. server=db1 (an database server computer named “db1” at the CS department of UA) server=hawkeye\wintellect (an instance of SQL Server named Wintellect on a remote machine named Hawkeye) Database or Initial Catalog: database name (e.g. Pubs) UID or User ID, Pwd: tempdb, tempdb

31. Server • Min Pool Size and Max Pool Size, the size of the connection pool (the defaults are 0 and 100) • Integrated Security: default to false, otherwise uses Windows access tokens for authentication. • Connect Timeout: how many seconds to wait for a connection to open (default=15). SqlConnection conn = new SqlConnection     ("server=hawkeye\wintellect;database=pubs;uid=sa;pwd=;" +    "min pool size=10;max pool size=50;connect timeout=10");

32. Exceptions and Closing Open Connections • Exceptions should never go uncaught, and open connections should always be closed before terminating. (Calling Close on a connection that’s not open isn’t harmful.) SqlConnection conn = new SqlConnection ("server=localhost;database=pubs;uid=sa;pwd="); //before try block try {conn.Open (); // TODO: Use the connection } catch (SqlException e) { Console.WriteLine (e.Message); // TODO: Handle the exception } finally { conn.Close ();}

33. Pattern of database programming • Create a connection object. • Open the connection. • Do not hardcode the connection string in your code. Use web.config and session cache to allow customization.

34. Congo (C9) Congo: A virtual storefront for an online bookseller. Related to: database => data grid => shopping cart Forms: Database supported, web based security. Examples\C9\Congo-MySQL http:/winserv1.cs.uakron.edu/xiaotest/Congo/Congo.aspx A mini enterprise application Deployment: http://www.cs.uakron.edu/~xiao/windows/4T-App-Deployment.html Output format in C# http://blog.stevex.net/string-formatting-in-csharp/

35. Structure of an ASP.NET Web Application An ASP.NET application. • The Web.config File To support XCOPY installs— to install applications by copying them to a directory and uninstall them by deleting the files and directories.

36. Strings defined in the .config file can be retrieved in the program at run time: string conn = ConfigurationSettings.AppSettings ["MyConnectionString"]; <!-- Web.Config Configuration File --> <configuration> <appSettings> <add key="MyConnectionString" value="server=db1; database=pubs; uid=sa; pwd=" /> <add key="connectString" value="Integrated Security=true;Initial Catalog=pubs; Data Source=XIAO-T23-01" /> </appSettings> </configuration> Web.config

37. Pattern of database programming • Create a connection object. • Open the connection. • Create a command object. • Execute the command.

38. Connections, Commands, and DataReaders • Connection objects represent physical connections to a database. SqlConnection or OleDbConnection • Command objects represent the commands performed on a database. SqlCommand or OleDbCommand • DataReader objects represent the data obtained by the commands. SqlDataReader or OleDbDataReader

39. Command Classes: SqlCommand and OleDbCommand. • Encapsulate SQL commands performed on a database. • Rely on connections established. • Include methods to execute the commands encapsulated inside. Example, delete a record from the Pubs database’s “Titles” table using an SQL DELETE command: SqlCommand  cmd = new SqlCommand         ("delete from titles where title_id = 'BU1032'", conn);     cmd.CommandTimeout = 10; // Allow 10 seconds, default 30. cmd.ExecuteNonQuery (); // Execute the command

40. The ExecuteNonQuery Method • For executing DML and DDL commands: CREATE, INSERT, UPDATE, DELETE, … • Not getting any data back. • Examples: SqlCommand cmd = new SqlCommand ("create database MyDatabase", conn); cmd.ExecuteNonQuery (); SqlCommand cmd = new SqlCommand ("create table titles …", conn); cmd.ExecuteNonQuery (); SqlCommand cmd = new SqlCommand ("insert into titles (title_id, title, type, pubdate) " + "values ('JP1001', 'Programming Microsoft .NET', " + "'business', 'May 2002')", conn); cmd.ExecuteNonQuery ();

41. The ExecuteNonQuery Method SqlCommand cmd = new SqlCommand ("update titles set title_id = 'JP2002' " + "where title_id = 'JP1001'", conn); cmd.ExecuteNonQuery (); SqlCommand cmd = new SqlCommand ("delete from titles where title_id = 'JP2002'", conn); cmd.ExecuteNonQuery ();

42. The ExecuteScalar Method Executes a query command and returns a single value in the result set, such as COUNT, AVG, MIN, MAX, and SUM. SqlCommand cmd = new SqlCommand ("select min (price) from titles", conn); decimal amount = (decimal) cmd.ExecuteScalar (); Console.WriteLine ("ExecuteScalar returned {0:c}", amount);

43. The ExecuteScalar Method • Another common use for ExecuteScalar is to retrieve BLOBs (binary large objects) from databases. • For example, retrieving an image from the “Logo” field of the Pubs database’s “Pub_info” table and encapsulates it in a bitmap: use System.IO; use System.Drawing; use System.Data.SqlClient; SqlCommand cmd = new SqlCommand ("select logo from pub_info where pub_id='0736'", conn); byte[] blob = (byte[]) cmd.ExecuteScalar (); stream.Write (blob, 0, blob.Length); Bitmap bitmap = new Bitmap (stream); stream.Close ();

44. Write a BLOB to a database. FileStream stream = new FileStream("Logo.jpg", FileMode.Open); byte[] blob = new byte[stream.Length]; stream.Read (blob, 0, (int) stream.Length); stream.Close (); SqlCommand cmd = new SqlCommand ("insert into pub_info (pub_id, logo) values ('9937', @logo)", conn); cmd.Parameters.Add ("@logo", blob); cmd.ExecuteNonQuery ();

45. The ExecuteReader Method • For performing database queries and obtain the results as quickly and efficiently as possible. • Returns a DataReader object. • Pulls back only the data to be “Read” by the DataReader not all records satisfying the query condition. SqlCommand cmd = new SqlCommand ("select * from titles", conn); SqlDataReader reader = cmd.ExecuteReader (); while (reader.Read ()) Console.WriteLine (reader["title"]); • Each call to “Read” returns one row from the result set. • It uses a property indexer to extract the value of the record’s “title” field. • Fields can be referenced by name or by numeric index (0-based).

46. DataReader • Reads data. • Reads schema (meta data) . • Stream-based access to the results of database queries. • Fast and efficient. • Read-only and forward-only. • Closing a DataReader: reader.Close( ) does NOT close the connection, only frees it for others to use. • D-E-F-E-N-S-I-V-E P-R-O-G-R-A-M-M-I-N-G.

47. DataSets • Set-based Database Accesses • capture an entire query in memory • support backward and forward traversal • edit data and propagate the changes back to the database.

48. DataSet, DataTable and DataAdapter • .NET supports set-based database accesses through three classes: • DataSet: equivalent of an in-memory database. It consists of a collection of DataTables. • DataTables are created by a DataAdapter (SqlDataAdapter and OleDbDataAdapter). • DataSet doesn’t interact with databases directly. DataAdapter reads the physical data sources and fills DataTables and DataSets

49. DataSets vs. DataReaders • To simply query a database and read through the records one at a time until you find the one you’re looking for, then DataReader is the right tool. DataReaders (1) retrieve only the data that you actually use, and (2) they don’t consume memory by not storing every record that you read, but (3) they can’t iterate backward. • To use all the query results and to iterate backward and forward through a result set, or to cache the result set in memory, use a DataSet. • Many controls that support DataSets are perfectly capable of binding to DataReaders.

50. DataGrid (GUI) • DataGrid is an ASP control for displaying datasets. • Database displaying procedure: • Use DataAdapter to get data from the database. • Fill the data into a DataSet • Bind the DataSet to a DataGrid • Select the fields (columns) to be displayed and their header texts.