Skip to main content

Monitoring Multiple Instances

Info

This document has been created based on the Oracle Monitoring V2. For the Oracle monitoring V1 document, see the following.

Home > Select Project > Dashboard > Monitoring Multiple Instances

While you can monitor only one agent (instance) in Monitoring a Database Instance, Monitoring Multiple Instances allows you to monitor and manage multiple agents (instances).

You can compare and analyze key performance metrics occurring in each instance at a glance. You can effectively perform monitoring by aggregating data such as the number of agents running, the sum of all active sessions, and the number of transactions. Users can easily check the changes in metric values ​​over time and high performance metrics for each instance through graph charts.

Additionally, users can see the longest-lasting active sessions, which can be used as a basis for diagnosing and resolving the system performance bottlenecks.

Multi-instance Monitoring

Tip

If you select an agent to compare in Dashboard > Instance List, and then select Multi view, the Monitoring Multiple Instances menu appears.

Viewing the past data

The dashboard basically provides real-time monitoring features in which you can view the past data.

Real-time modeNon-real-time mode
Real-time modeNon-real-time mode
  1. Select Pause icon in the time selector at the upper left of the screen.

  2. Click the date and time to set the desired time zone.

    Configure manual time

  3. Select Apply.

It updates the data in widgets placed on the dashboard based on the set time. To switch to the Realtime mode, select Playback icon.

Checking the agent

Checking the agent connection status

On the upper left of the screen, the right area of the time selector provides information that allows you to check the status of agents connected to the project. This allows you to immediately check whether the target application server is running.

  • Total: Number of all agents connected to the project

  • Active: Number of active agents

  • Inactive: Number of inactive agents

  • Agent display icon: Can display or hide inactive agents.

Agent-based monitoring

Selecting the agent

By default, the dashboard displays the metrics collected from all agents in charts and you can also view the data by agent. Select one or more agents under the time selector. The data of the widgets on the dashboard is updated with the metrics of the selected agent(s).

Tip

To select all agents again while one or more agents is selected, deselect them or select Total.

Note

If there are numerous agents connected to the project, it is efficient to set the agent names to be short. For more information about the agent name setting, see the following.

Monitoring agents for each cluster

Agent by each cluster

If you are using Oracle Real Application Cluster (RAC), click the service name in Agent by cluster and select the Default(RAC) preset from the presets to monitor. You can check the metrics based on the instances running in the RAC database.

Editing a dashboard widget

The widgets on the dashboard can be adjusted to the desired size and placed in the desired positions. You can also delete unnecessary widgets or add them again.

Resizing a widget

Resizing a widget

Click and hold the mouse on the Resize icon element at the lower right of the widget, and then drag it to the desired size. Grids with a uniform horizontal-to-vertical ratio appear and the size of the widget can be adjusted in each grid.

Moving a widget

Moving a widget

When you move the mouse cursor to the top of the widget, the cursor shape changes to Move icon. At this time, you can move the widget by dragging with your left mouse button and move to the desired position.

Deleting a widget

Deleting a widget

Right-click on a widget to delete. If you select Delete, the widget is deleted from the dashboard.

Adding a widget

Adding a widget

Move the mouse cursor to an empty space on the dashboard and then right-click on it. Select a widget to add from the pop-up menu. Place the widget to the desired position and then resize it.

Note
  • For more information about the widgets that can be placed on the dashboard, see the following.

  • In addition to the metrics provided by default on the dashboard, you can add the desired metrics. For more information about custom widgets, see the following.

Custom widget

The custom widget feature allows users to add their own metrics in addition to the metrics provided by default on the dashboard. If you have metrics to continuously monitor on the dashboard in addition to the metrics provided by default, use the custom widget feature.

Add

  1. Right-click an empty space on the dashboard.

  2. On the pop-up menu, select Add Custom Widgets.

  3. If Custom Widget is created on the dashboard, select Select indicator.

    Custom widget

  4. When the Add Custom Widgets window appears on the right of the screen, enter the widget name in Title.

    Custom widget

  5. In the metrics list at the bottom of the screen, select the Add icon button on the upper right of the metric to add.

  6. After the metric has been changed, select Save.

Note
  • You can add up to four metrics. To add metrics, select Add icon.

  • Ti change the metric, select a different metric in the metrics list. If you select Add icon, the metric is added.

  • If you do not enter the widget title, it is saved as a custom widget.

Selecting the chart type

In chart type of the Add Custom Widgets window, you can select the following types.

  • Graph icon Series: Time series chart that displays the metric changes over time.

  • Graph icon Equalizer: Bar graph chart that can compare the performance for multiple metrics. By visually displaying various metrics on one screen, you can easily see the overall performance status.

  • Graph icon Pie: Pie chart useful for checking the composition ratio for multiple metrics relative to the whole.

  • Text icon Text: It displays the figures for the metrics in text.

Selecting the data merging method

In Merge target of the Add Custom Widgets window, you can select the way to display metrics collected from agents.

  • Sum: It sums up the metric values ​​collected from multiple agents and displays them as a single value. This option is useful for displaying the overall total by merging data from multiple agents.

  • Avg: It averages the metric values ​​collected from multiple agents and displays them as a single value. This option is useful for checking the average performance or status of all agents.

  • Max: By selecting the largest value among the metric values ​​collected from multiple agents, it displays a single value. This option is useful for identifying the highest performance consumption or worst performance cases among agents.

  • No Merge: It displays the metrics for each agent.

Note

The available merge method may differ depending on the chart type.

Changing a metric

You can change or add metrics for the metrics added to the custom widget.

  1. Select Configuration icon on the upper right of the custom widget added on the dashboard.

  2. When the Add Custom Widgets window appears on the right of the screen, select a metric to change.

    Custom widget

  3. Select a metric to change from the metric list at the bottom of the screen. To add a metric, select Add icon on the upper right of the metric to add.

  4. After the metric has been changed, select Save.

Tip

The features of the icon buttons in the list for added or changed metrics are as follows:

  • Delete icon: You can exclude the metric from the custom widget.

  • Alert icon: You can set the alert for the metric. When the button is selected, the Alert > Event Configuration appears. For more information about the Metrics event setting, see the following.

Using the widget options

The icons displayed on the widget function as follows:

  • Information icon: You can see the features and information for major widgets. (multilingual support planned)

  • Up arrow icon or Down arrow icon: You can enlarge or reduce the range of the vertical axis.

  • Fullscreen icon: You can view the widget's data on a wider screen.

  • Detail icon : A detail window appears where you can search the data of the widgets separately by agent.

Note

The provided options may differ depending on the widget.

Setting presets

You can save and load the settings and layouts for widgets on the dashboard. You can create a new preset by adjusting its size and placing it on the desired position.

Preset

  • Default: This preset consists of XOS metrics, AWS RDS CloudWatch metrics, and major DB metrics.

  • Default(xos): This preset consists of XOS metrics and major DB metrics.

  • Default(rds): This preset consists of AWS RDS CloudWatch metrics and major DB metrics.

Note

The default preset (Default) cannot be changed.

Creating a new preset

  1. Place the widgets in the desired format on the dashboard. You can also resize and place only the widgets to be frequently checked.

  2. On the upper right of the screen, select Save icon.

  3. Enter a new preset name.

    Preset

    To save the selected agent data, select Include agent selection history.

  4. Select Save.

You can see the newly saved preset from the preset list.

Note
  • If any changes are made to the newly created preset, save the preset again. Select Save icon and then save the preset with the same name. Any changes are overwritten in the existing preset.

  • If you go to another menu without saving changes on the dashboard, the changes are not saved.

  • Presets are saved on a project basis and can be shared with other users.

Deleting presets

If you have unused presets, you can delete them from the preset list. Select Delete icon on the right of the item to delete from the preset list.

Note

The Default preset cannot be deleted.

Learning about the main widgets

The types of widgets that can be placed on the dashboard are as follows.

XOS widgets

  • [XOS] CPU

    You can see the CPU usages for each agent in real time.

  • [XOS] Memory

    You can see the memory usages for each agent in real time.

  • [XOS] Disk Usage

    Displays the disk utilizations, free sizes, and total sizes for each agent.

    • Detail icon: The Disk usage details pop-up window appears. You can check the chart that displays the disk usage by time zone. You can check the data by instance. By selecting Size, Free, or Used, you can see the total size, remaining size, and size in use.

    • Zoom in icon: You can expand the table on the widget to a wider screen.

    Tip

    If there is no data displayed, add the following settings to the xos.conf file.

    xos.conf
    # Off if the disk usage is 0; unit: second
    disk_usage_interval=60

Oracle RAC widget

  • [RAC] Load Balance

    You can monitor the resources of instances running on the Oracle RAC (Real Application Clusters) database in real time. Users can visually monitor the load and performance metrics for their database. You can check the CPU performance, active sessions, physical read operations, and available memory.

  • [RAC] Interconnect Bandwidth

    This widget monitors the interconnect bandwidth used in Oracle RAC (Real Application Clusters). You can monitor the network traffic between databases and instances within a cluster by displaying the communication bandwidth between database nodes in real time.

  • [RAC] Main Waits

    You can see the global lock status and the numbers of waits for each event. This widget queries the total number of waits for each event through metrics collected for a specific database category and extracts the most recent data for each agent (instance). This allows you to see the database wait events promptly at a specific time.

Database widgets

The provided widgets allow you to check the status of various system resources, such as CPU, memory, and disk I/O, as key metrics for database performance analysis.

  • Active Sessions

    It visually displays the numbers of active sessions over time in a time series chart. This widget traces and graphs the numbers of sessions running in the database over time. It is useful for visually checking the session usage patterns and load.

  • Lock Wait Sessions

    It visually displays the numbers of lock waiting sessions over time in a time series chart. This widget traces the numbers of sessions in lock waiting state in the database over time and displays it on the graph in real time.

  • Long Active Session Count

    It provides information about active sessions running on the database for long time. A chart appears for information aggregated by time zone with grouped by the session execution time. It can identify long-running sessions with performance issues or resource leaks in the database, or classify the sessions based on the execution time to visually display which sessions stay active for long time.

    It appears in blue for less than 3 seconds, green for 3 seconds or more that is less than 10, orange for 10 seconds or more that is less than 15, and red for 15 seconds or more.

  • Long Waiting Session Count

    It provides information about the long-term latency of the sessions holding or waiting for locks in the database. By combining lock information and active session information, you can trace long-term latencies for queued sessions. It monitors the sessions that are holding locks or waiting for long time. You can visually see which sessions are holding locks or waiting for long time.

    It appears in blue for less than 5 seconds, green for 5 seconds or more that is less than 10, orange for 10 seconds or more that is less than 60, and red for 60 seconds or more.

  • SQL Elapse Map

    Displays a real-time chart for the elapsed times of running queries. If you drag a specific part of the chart, the Query List appears. You can enlarge or reduce the range of the vertical axis by selecting Up arrow icon or Down arrow icon.

    Note

    The execution times of queries are calculated after collecting active sessions. Therefore, depending on the active session collection cycle, there may be a margin of error. See the following figure. The execution times of SQL queries that have ended within the collection cycle are not calculated. A shorter collection cycle may decrease the margin of error, but considering the database load, it is typically set to 5 seconds. It is useful for monitoring long-running queries. The same is true for the data in SQL statistics.

  • Wait Event

    It displays a real-time graph for the names of the waiting events that each backend process is waiting on, along with the frequency with which those events occurred. It mainly monitors waiting events related to application, configuration, administrative, network, and the like. You can visually see the frequency of each waiting event. If you hover your mouse over the graph, a tooltip is displayed providing more information about each waiting event.

  • Physical Reads

    This widget monitors physical reads occurring in the database. It monitors the I/O performance of the database, by providing statistics on the operations where the database reads data from the disk.

  • Excute Count

    This widget monitors the numbers of queries or procedures executed in the database. It traces the numbers of queries or procedures executed by the database in real time and provides them to the user.

  • Session Logical Reads

    This widget monitors logical reads executed in the database session. It traces and provides real-time visibility to users on the number of logical read operations executed in the database session.

Session Table widget

You can view real-time active sessions and lock trees in the Session Table widget at the bottom of the screen.

  • Active sessions: You can view active sessions and queries.

    • If you select a session running, the Session detail window appears. You can see the details for the selected session. For more information, see the following.

    • If you select an item in the rightmost query_text column in the table, the SQL details window appears. You can see the full text and plan information for the selected query. For more information, see the following.

  • Lock tree

    You can see the lock session information, and holder and waiter information in real time. For more information about the table columns, see the following.

Note

In the table list, the text colors are changed black → orangeRed, which means that the performance of the session is getting slower.

Checking the session information details

If you select a session in the Active sessions tab, the Session detail window appears. You can see the information details about the selected session.

Session detail

  • The session information is viewed in real time by default. If you select Pause icon in the time selector, you can stop a real-time view and see the data based on the paused time. To refresh data while pausing a real-time view, select Refresh icon.

  • Kill Session: You can stop the selected session. If the Session kill window appears, enter the password (Parameter Key) and then select Apply.

    Note

    This feature is only available in real-time viewing mode.

  • Session history: You can go to the Session History menu to see the records of the selected session.

    Note

    For more information about Session History, see the following.

  • Session Stat: It provides various performance metrics and statistical information for the selected session. It includes the type and number of tasks performed in the session, resource usage, and more.

  • Delta / Sigma: The change rate and statistical analysis information for the selected session appear. You can check the amount of change in session activities.

  • Session Info: You can see the basic information of the selected session and the information details including the status.
  • Wait Info: The waiting event and waiting time of the selected session are provided. You can also see information about the waiting events that occur when the database system is waiting to execute a specific task.

  • SQL Text / Plan: You can see the SQL query statements and plans of the selected session. For more information, see the following.

See query details

To check the SQL query information of the executing session, select the query (or sql_text) column in the Active sessions section. The SQL details window appears. You can check the SQL query statements and plan information.

SQL details

  • View SQL Statistics: You can go to the SQL statistics menu where you can check statistical information related to the SQL query statement.
  • Runtime Plan: It provides the execution plan and runtime information for a selected SQL query. It provides the information details such as execution count, average execution time, and average physical reads.

  • Explain Plan: It displays the execution plan predicted by the optimizer. It provides information such as cost, job, object name, and cardinality.

  • Plan History: You can check the history of the execution plans of the SQL queries executed in the database.

  • Bind Capture: You can see the values ​​of the bind variables used in SQL queries executed in the database. This allows you to see actual content of query executions.

    Note

    This is a value captured in the database (v$sql_bind_capture), not a bind value executed in real time. If the number of cases is too large, it displays up to 100.

Filtering the table data

Filter

  1. Select Filter icon on the upper right of the table.

  2. Select a column header and a condition in the table.

  3. Enter a desired value in the Enter conditions field.

  4. Select Save.

Setting the table columns

You can hide the table header columns or add any of them. You can also change the column order. Select Column icon.

Column Settings

Note
  • After configuration, select Confirm to apply the settings in the table.

  • In the number 3 search bar, enter text to search the desired columns. Only the columns that meet the entered text are displayed.

  • Images may differ depending on the product, project, or menu.

Adding columns

From the Number 1 list, select the items to add as table header columns. To select all items, select Select All.

Deleting columns

From the number 1 list, unselect the columns to delete. Alternatively, select Delete icon on the right of the item to delete from the number 2 list.

Changing the column order

Drag an item to reposition from the number 2 list, and then move it to the desired position.

Initializing the configuration

To cancel all changes and reset them, select Reset icon Initialized.

Column information guide

For more information about columns, see the link.

ItemDescription
sidSession ID
cpu(xos)CPU utilization collected by the installed XOS
serial#Value to increment to determine if the same session ID has been used.
usernameDB user name.
commandSame as COMMAND_TYPE; SQL command number
statusSession status
schemanameSchema. Same as the username.
osuserUsername of the OS that accessed the session.
spidOS process ID.
processID of the client process that accessed the session.
logon_timeSession created time point.
last_call_etIf the session is active, it is the elapsed time (sec) since activation.
sql_textquery, running statement, SQL statement that separates literal strings
sql_paramLiteral value separated from query
prev_sql_textPreviously executed query
prev_sql_paramPreviously executed query param
programProgram information executed by client
typesession type - can be adjusted in user background recursive (whatap.conf).
seq#Number that uniquely identifies the current or last wait (incremented with each wait)
eventNumber of the resource or event if the session is waiting.
p1First waiting event parameter (decimal point)
p2Second waiting event parameter (decimal point)
p3Third waiting event parameter (decimal point)
wait_classClass name of the waiting event
wait_timeThe value is 0 if the session is waiting. It is the last waiting time (milliseconds) if the value is greater than 0.
seconds_in_waitTime spent waiting for the wait if the session is waiting. Otherwise, it is the time elapsed since the last waiting.
stateWaiting state: WAITING, WAITED UNKNOWN TIME, WAITED SHORT TIME, WAITED KNOWN TIME
machineName of the client server that accessed the session (hostname)
portClinet port number
terminalClient terminal name
moduleName of the module set by the user of the program executed on the client.
actionAction name set by the user of the running module.
client_infoClient information set by user
client_identifierClient ID set by user
session logical readsNumber of times data was read into the buffer cache
physical readsNumber of data reads from the physical disk
execute countSQL execution count
parse count (hard)Total number of syntax analysis calls (actual syntax analysis)
parse count (total)Total number of syntax analysis calls (hard, soft, describe)
opened cursors currentNumber of open cursors
db block changesChange count of all blocks in the database
session pga memorySession's current PGA size
undo_segidUndo information ID
undo_blkUndo block count
undo_recUndo record count
sql_addressSQL statement identification data
sql_hash_valueSQL statement identification data
sql_idSQL ID of the running SQL statement
sql_child_numberSub number of the running SQL statement
sql_exec_startStart time point of SQL running in the session
sql_exec_idSQL running ID
prev_sql_addrInformation that identifies the last run SQL statement
prev_child_numberSub number of the last SQL statement executed
prev_exec_startStart time point of the last SQL statement executed
prev_exec_idStart ID of the last SQL statement executed
plsql_entry_object_idObject ID of the top PL/SQL subprogram on the stack.
plsql_entry_subprogram_idID of the top PL/SQL subprogram on the stack.
plsql_object_idSubprogram ID of the running PL/SQL object
taddrTransaction address
lockwaitlock wait address (lock address where the session is waiting)
row_wait_objObject ID of the table containing the row specified in ROW_WAIT_ROW#
row_wait_fileID of the data file containing the row specified in ROW_WAIT_ROW#
row_wait_blockID of the block containing the row specified in ROW_WAIT_ROW#
row_wait_rowCurrently locked row
pdml_statusIf the value is ENABLED, the session is in PARALLEL DML activation mode. If the value is DISABLED, the session does not support the PARALLEL DML activation mode. If the value is DISABLED, the session does not support the PARALLEL DML activation mode.
pq_statusIf the value is ENABLED, the session is in PARALLEL QUERY activation mode. If the value is DISABLE, the session does not support the PARALLEL QUERY activation mode. If the value is FORCED, it indicates the session was changed to force the use of PARALLEL QUERY.
blocking_session_statusIt provides details about whether there is a blocking session.
blocking_instanceInstance ID for the blocking session
blocking_sessionSession ID for the blocking session
final_blocking_session_statusIt provides details about whether there is a last block session.
final_blocking_instanceInstance ID for the last blocking session
final_blocking_sessionSession ID for the last blocking session
service_nameService name of the session. It is similar to the DB name.
saddrSession address
con_idID of the container associated with the data (only for multi-database support)
rss(xos)OS metrics collected by the XOS agent
pss(xos)OS metrics collected by the XOS agent
ioread(xos)OS metrics collected by the XOS agent
iowrite(xos)OS metrics collected by the XOS agent
Note

WhaTap basically stores the client-related information.

Downloading the view list

You can download the current Session Table list in CSV format. Select Download icon on the upper right of the Session Table section.

The naming format of the downloaded file is as follows:

  • Active sessions: activeSession_HH_MM_SS.csv

  • Lock tree: lockTree_HH_MM_SS.csv

Viewing in a new window

You can see the Session Table list on a new wider screen. Select New window icon on the upper right of the Session Table section.