450 likes | 711 Views
FNST’s QAD Monitoring. One part of the monitoring/management initiative for FNST/FST. Agenda. Intro – About FNST Background/History QAD Implementation Present State Benefits Realized Future Directions Quick Review (screenshots) Lessons Learned Q&A.
E N D
FNST’s QAD Monitoring One part of the monitoring/management initiative for FNST/FST
Agenda • Intro – About FNST • Background/History • QAD Implementation • Present State • Benefits Realized • Future Directions • Quick Review (screenshots) • Lessons Learned • Q&A
Freudenberg-NOK Sealing Technologies Established 1989 Headquartered in Plymouth, Mich., USA (Privately Held) Established 1849 Headquartered in Weinheim, Germany (Privately Held) Established 1939 Headquartered in Tokyo, Japan (Publically Traded on the NSS)
Diverse and Established Partners Headquarters Plymouth, Michigan Weinheim, Germany Tokyo, Japan Established 1989 1849 1939 2008 Sales $1 Billion $6.5 Billion $4.5 Billion Ownership Privately Held Privately Held Publicly Held Products Radial Shaft Seals O-Rings Gaskets Fluid Power Products Diaphragms Specialty Sealing Products Radial Shaft Seals O-Rings Gaskets Fluid Power Products Oil and Gas Products Diaphragms Specialty Sealing Products Vibration Control Devices Medical Products Radial Shaft Seals O-Rings Gaskets Fluid Power Products Diaphragms Specialty Sealing Products Vibration Control Devices
Freudenberg Global locations Production Sales Production and Sales
Plymouth, MI Technology Center Shelbyville, IN Milan, OH Boots & Bellows Heavy Industry Lead Center, Imported Products Troy, OH Findlay, OH PTFE Products PTFE Products Morristown, IN Custom Molded Rubber Products Santa Ana, CA O-rings Cleveland, GA Sao Paulo, Brazil Radial Shaft Seals Valve Stem Seals and Powertrain Seals Querétaro, Mexico O-rings Cuautla, Mexico Radial Shaft Seals and Custom Molded Rubber Products and Vibration Control Devices Production Locations in the Americas New Hampshire Facilities: Ashland–Aerospace Radial Shaft SealsIndustrial Radial Shaft Seals Bristol –Mechanical Face Seals, Bonded Piston Seals Northfield –Axle Seals Necedah, WI Gaskets Manchester– Gaskets Manchester– Microcellular Polyurethane LaGrange, GA O-rings Elgin, IL Simrit Sales Office Tillsonburg, ON Silicone and Fluoro-silicone Products
Freudenberg-NOK Sealing Technologies Today • Responsible for sealing technology business in the Americas • Total sales in 2010: US$ 798.7 million • Workforce in 2010: 4,224 • Locations in: U.S., Canada, Mexico, • Brazil, Malaysia, China • Sales exceeded market recovery in 13 • of 15 principal market segments • Sites: 35 production, sales and • technical facilities
Agenda • Background/History • QAD Implementation • Present State • Benefits Realized • Future Directions • Quick Review (screenshots) • Live
Background/History HP OpenView implemented in 1994 Dedicated a great deal of effort to include Progress and QAD in our monitoring/management Versions not kept current (budget constraints) to support our Linux environment
Agenda • Background/History • QAD Implementation • Present State • Benefits Realized • Future Directions • Quick Review (screenshots) • Live
QAD Implementation • Contracted QAD Services. • “Canned” product, virtual Linux server (recover image and change IP), Icinga and Cacti for alerting and graphing. • “Base” configuration file created. Deployment simplified, copy base and change host info. • Scripts built for deploying: • Database monitors based on our “/node/info/databases” file (list of databases per host with environment, used for many purposes including start-up). • Disk statistics. • - Graphs too.
Our Environment Centralized 2010SE Host (co-lo in NC) Supporting 30 sites from Canada to Mexico Distribution Site Linux eB2 (our facility in OH) Brazil Site Linux 2007
Our Monitoring Environment Each host has a system “control” file containing all databases and environments This allows easy scripting of status checks, up/down, and query from other applications and scripts to invoke This file allowed us to automate our monitoring implementation
Database Control File ###################### /prod/prddbhe10/prddbhe10 DEFAULT hlpea PRODEA10 QAD_add-on /prod/prddbqxo17/prddbqxo17 DEFAULT qxodb PRODEA10 QAD_add-on ####################### /prod/prdcmbme10/prdcmbme10 DEFAULT mfgdb PRODEA10 Prod_QAD /prod/prdcmbae10/prdcmbae10 DEFAULT admea PRODEA10 /prod/prdcmbfe10/prdcmbfe10 DEFAULT fngpea PRODEA10 FNGP_QAD_add-on /prod/prdcmbte10/prdcmbte10 DEFAULT tpea PRODEA10 TailorPro /prod/prdcmbev17/prdcmbev17 DEFAULT qxevents PRODEA10 Qxtend_events ####################### ## Corteco Mexico ####################### /prod/prd73me10/prd73me10 DEFAULT mfg73 PRODEA10 Prod_QADmexico /prod/prd73ae10/prd73ae10 DEFAULT admea PRODEA10 /prod/prd73fe10/prd73fe10 DEFAULT fngpea PRODEA10 FNGP_QAD_add-on /prod/prd73te10/prd73te10 DEFAULT tpea PRODEA10 TailorPro /prod/prd73ev17/prd73ev17 DEFAULT qxevents PRODEA10 Qxtend_events #######################################################
Site Monitoring Ping a host in each supported site Good method of determining how a site sees performance
Scripts for Automation of Monitoring Services ./build_server_cfg.sh [remote host] [DLC] Builds a file with the Icinga components for Progress database monitors based on the control file. This generated file gets inserted into the host’s configuration file in Icinga. Creates Icinga monitors for DB check, extents, log entries, last backup, buffer hits, read rates, and locks ./build_server_graph.sh [remote host] [DLC] Queries for host ID, then creates Cacti graphs for each database in the control file ./build_server_disk.sh [remote host] Ran a “df” on the remote host, builds Icinga space monitor for each local disk, insert into host’s configuration file.
Script to Build Configuration File copy the template to [servername]-server.cfg cpfnst-server.cfg.template [servername]-server.cfg find and replace ral2lnxqad with the server name edit the host IP correct the webspeed entries correct DLC if needed build the databases section: ./build_server_cfg.sh [remote host] [DLC]
Agenda • Intro – About FNST • Background/History • QAD Implementation • Present State • Benefits Realized • Future Directions • Quick Review (screenshots) • Lessons Learned • Q&A
Present State All Linux hosts monitored (ping, OS) All sites monitored (ping to a host in all sites) All Linux QAD hosts monitored (Progress databases, NetUI performance)
Agenda • Intro – About FNST • Background/History • QAD Implementation • Present State • Benefits Realized • Future Directions • Quick Review (screenshots) • Lessons Learned • Q&A
Benefits Realized Network issues identified “stair step” graph noticed, turns out cable disconnect at site Qxtend performance issue Alert on CPU utilization, worked w/ EA Team Cache Hit Rate Alert, increased “Big B” DB Writes/Min Worked w/ ERP Team, identified code that was not “domainized”
Agenda • Intro – About FNST • Background/History • QAD Implementation • Present State • Benefits Realized • Future Directions • Quick Review (screenshots) • Lessons Learned • Q&A
Future Direction Regular internal review. Regular review with ERP Team. Review what else would benefit us. Remote point(s) for monitoring. NetUI testing for one. With the implementation of Vmware in remote sites we may just deploy VM Include HPUX (retire OpenView). Visibility to others outside the Server Team. Migrate additional legacy performance and monitoring scripts Review how to play with SCOM
Agenda • Intro – About FNST • Background/History • QAD Implementation • Present State • Benefits Realized • Future Directions • Quick Review (screenshots) • Lessons Learned • Q&A
Quick Review Alerts Graphs
Alerts Graphical, Emails
Graphs Hourly (min avg), Daily (5 min avg), Weekly (30 min avg), Monthly (2 hravg), Yearly (1 day avg) Data points include: Ping Response Host Statistics QAD Users DB Reads Time to Read 10K Records Database Performance Statistics NetUI View
Site Overview We included (at least) one host in each of the sites accessing our central QAD servers This gives us up/down and response times by site, assisting in troubleshooting issues
Statistics Specific to QAD Hosts Processor statistics QAD users Database statistics NetUI performance
Live Point browser to http://ra2sqadmon
Questions? Questions, Suggestions, Comments,