Enterprise Manager Presentations at RMOUG Training Days 2015

RMOUG Training Days – Feb 17-19 (Denver)

This is a great regional Oracle User’s Group conference with some of the best speakers you’ll find on multiple subjects!  Something enticing about being in freezing cold temperatures during ski season I think?  My colleague Kellyn Pot’vin-Gorman does a great job promoting it and making sure people get a great educational experience.   If you’re in the area, it’s a great 2 day conference!   See the agenda and register now!

I will be presenting two sessions on Thursday: Smarter Monitoring with Adaptive Thresholds and Time-Based Metrics and  Enterprise Manager 12c: Extending Beyond the DBA.  Several of my colleagues will also be there presenting and running Deep Dives covering Enterprise Manager, check out the line up of Oracle speakers presenting on #EM12c:

Tuesday 2/17
1:00 – 3:00 Hands-On: Delivering Schema as a Service with Enterprise Manager (Pete Sharman)

3:15 – 5:15 Hands-On: Delivering Pluggable Database as a Service with Enterprise Manager (Pete Sharman)

Wednesday 2/18

8:30-9:30 A Day in the Life of an Enterprise Manager Agent (Andrew Bulloch)

12:15-1:15 SIG Meetings – Enterprise Manager 12c

2:30-3:30 Enterprise Manager Snap Clone: Snapshot Your Data without Snapping Your Storage (Pete Sharman)

Thursday 2/19

9:45-10:45 Smarter Monitoring with Adaptive Thresholds and Time-Based Metrics (Courtney Llamas)

11:15-12:15 Enterprise Manager 12c: Extending Beyond the DBA (Courtney Llamas)

2:45-3:45 Under the Hood of Enterprise Manager: A Troubleshooting Primer (Werner De Gruyter)

4:00-5:00 The Power of the AWR Warehouse (Kellyn Gorman)

4:00-5:00 The High Availability Enterprise Manager Roundtable (Werner De Gruyter)

Enterprise Manager Patching FAQ

Every time a new plug-in, patch or PSU comes out for Enterprise Manager, I get a series of questions.   I’m going to quickly address a few of the ones I’ve gotten this month with the release of the new plug-ins and the PSU patches to try and help you in updating your EM site. I wrote a detailed blog EM Patching 101 about the various patches, and that’s still relevant so read if you haven’t (or read it again)!

What’s the difference between the Plug-in release (released 1/5/2015) and the Plug-in system bundle (released 12/31/2014)?  

The plug-in system bundle will come out every month on the last day of the month.  The next one is scheduled for 1/31/2015.   This is a cumulative compilation of monthly plug-in bundle patches.   So it will look at what plug-ins you have installed on the OMS, and it will deploy the latest plug-in patch bundle to that plug-in.  It will skip what you don’t have installed.   These patches will include fixes and will be indicated by the 5th digit in the version.  For example, the latest Database plug-in patch was 12.1.0.6.7.

The plug-in updates released on 1/5 were full plug-in version upgrades.  These need to be deployed to the OMS by using Extensibility -> Plug-ins and deploy to OMS.  They may require downtime.  Plug-in updates for Database, Fusion Middleware, Storage Management and Cloud were released.  These updates include new features and fixes.   For example, the Database plug-in is now 12.1.0.7.0.

Which one should I apply?

My recommendation would be to test and apply both.   The plug-in updates for Database and other components you use have the latest features and code that will enable new features or improvements.   You will also want to apply the latest system bundle patch (whether it’s December’s or January’s) to patch the other plug-ins that did not get updated (MOS for example).

Should I deploy the new Plug-ins first or apply patches first?

My suggestion is to apply the Plug-in updates first.  The plug-ins released in January include Database, Fusion Middleware, Cloud and Storage Management plug-ins.  When you download and apply these to the OMS, and Agents if required, they will not need the patches from the December 31st patch bundle, and you’ll have the most recent update. After deploying the plug-in updates, when you apply the Plug-in System patch (20188140) you will see that the updated plug-ins (DB, MW, etc) are skipped.

How often should I patch EM?   Agents?

I recommend to most my customers to stick to a quarterly patching cycle, and this typically follows the PSU cycle.  So start looking at the patches that are released in the January PSU and testing them.  At that time, grab all the recommended or latest plug-in and agent patches, and apply those as well.   The agent and plug-in patches will come out monthly, and if you need a patch for a particular bug or issue, then you should apply.  However, patching EM monthly is not feasible for most customers.

What patches do I need to apply as of now (January 2015)?

As mentioned in the previous Patching 101 blog, there’s multiple components involved that each have their own patch. So here’s what I’d recommend if you were my customer deploying or updating this month:

  • Latest Database PSU Patch (1/15) for your repository version
  • OMS 12.1.0.4.2 PSU Patch – 19830994
  • OMS 12.1.0.4.7 Plug-in System Patch – 20188140
  • Weblogic 10.3.0.6.0.10 PSU Patch – 19637463
  • WebLogic Server one-off recommended – 16420963
  • OPMN Patch (CVE-2014-4212) – 19345576
  • Oracle Help Patch (CVE-2015-0426) – 20075252
  • Agent 12.1.0.4.4 Bundle – 20109357
  • Agent Plugin Patches for non-Updated plug-ins as necessary – From Doc ID 1900943.1  (Siebel, OVI, Exadata)

When I apply Weblogic PSU it has a conflict, can I roll it back and how do I do it?

When you follow instructions to apply the PSU, you may receive a warning that there’s a conflict and patches are mutually exclusive such as the following:

$ ./bsu.sh -install -patch_download_dir=<MW_HOME>/utils/bsu/cache_dir -patchlist=12UV -prod_dir=<MW_HOME>/wlserver_10.3
Checking for conflicts..
Conflict(s) detected - resolve conflict condition and execute patch installation again
Conflict condition details follow:
Patch 12UV is mutually exclusive and cannot coexist with patch(es): FSR2

You must first deinstall the conflict patch first, and install the new PSU.  The patches are cumulative.

$ ./bsu.sh -remove -patchlist=FSR2 -prod_dir=<MW_HOME>/wlserver_10.3
Checking for conflicts..
No conflict(s) detected
Removing Patch ID: FSR2..
Result: Success

Now you can install the new PSU:

$ ./bsu.sh -install -patch_download_dir=<MW_HOME>/utils/bsu/cache_dir -patchlist=12UV -prod_dir=<MW_HOME>/wlserver_10.3
Checking for conflicts..
No conflict(s) detected
Installing Patch ID: 12UV..
Result: Success

How do I apply the Oracle Help Patch (20075252)?

The January PSU calls for 17617649 on the Oracle Help product but this conflicts with a pre-existing EM patch.   There is a merge patch 20075252 that is available for this.  The Oracle Help patch is applied to the <MW_HOME?/oracle_common and uses the OPatch from that directory as well.    Read the readme.txt for full patching steps, but some tips are listed here in applying.

emctl stop oms -all
export MW_HOME=<MW_HOME>
export ORACLE_HOME=$MW_HOME/oracle_common
export PATH=$ORACLE_HOME/OPatch:$PATH

You should be able to do an opatch lsinventory and get the output of the ORACLE_HOME and the opatch apply should be similar to below:

How do I apply the OPMN Patch (19345576)?

Following the readme.txt it wants you to set Oracle Home to the  Classic/WebTier home.  For EM, this is the MW_HOME/Oracle_WT directory.

emctl stop oms -all
export MW_HOME=<MW_HOME>
export ORACLE_HOME=$MW_HOME/Oracle_WT
export PATH=$MW_HOME/oracle_common/OPatch:$PATH

You should be able to do an opatch lsinventory and get the output of the ORACLE_HOME and the opatch apply should be similar to below:

Let me know if you have any other patching questions and I’ll add them here!

On the Books for 2015…

As always, starting 2015 with a full plate! Several presentations and papers in the works for the next few months… now if my kids could stay healthy and get back to school so I can get some real work done!   One webinar, 2 presentations, 1 whitepaper and a hands on lab in progress… oh and finding time to blog on my list of topics that keeps growing…

IOUG Webinar – Jan 21 at 12:00pm CDT – Online

I’m excited to do another webinar for IOUG this year, covering EM install and setup.  Be sure to register!

Zero to Manageability in One Hour: Build a Solid Foundation for Oracle Enterprise Manager 12c

The goal in every Oracle Manager 12c rollout is to take it from zero to manageability in the shortest time possible. This presentation will show you how to accomplish this feat.

Speakers will demonstrate how to properly architect and deploy Oracle Enterprise Manager 12c implementation, including designing for high availability and scalability. Through this demonstration a list of essential techniques and tips compiled from Oracle Enterprise Manager Development’s Strategic Customer Programs team will also be shared.   Topics such as users, roles, groups, templates, and incidents will be discussed, plus key architectural decisions.

By attending this webinar, attendees will learn how to:
• Organize targets, notifications and users properly
• Configure for best practices after the install is complete
• Properly plan and architect an EM 12c environment

RMOUG Training Days – Feb 17-19 – Denver, CO

This is a great regional Oracle User’s Group conference with some of the best speakers you’ll find on multiple subjects!  Something enticing about being in freezing cold temperatures during ski season I think?    I  don’t ski, but I love this conference because I can get a little personal benefit from it.  I grew up in Fort Collins, CO and proud to be a CSU Ram.  I still have many friends and family there so when I get back I try to meet up with someone!

My colleague Kellyn Pot’vin does a great job setting up the agenda and making sure people get a great educational experience.   If you’re in the area, it’s a great 2 day conference at reasonable rates.   See the agenda here and register.

I will be presenting Enterprise Manager 12c: Extending Beyond the DBA on Thursday at 11:15.    Several of my colleagues will also be there presenting and providing Hand on Labs covering Enterprise Manager and we’ll also be holding an EM Roundtable to wrap up the conference.

Collaborate – April 12-16 – Las Vegas, NV

Last year was my first year at Collaborate and I was surprised at how big and diverse this conference was for a User Group sponsored event.  They’ve done a great job making it a full week of great sessions, exhibits and labs!  If you haven’t gone before, maybe this is the year to check it out?   You can find out about registration here.

I don’t have the schedule for my sessions, but I do know it’s going to be busy!   I have two sessions scheduled so far – Zero to Manageability in One Hour: Build a Solid Foundation for Oracle Enterprise Manager 12c and Smarter Monitoring with Adaptive Thresholds and Time Based Metrics.  I’m also co-presenting with Werner  on Under the Hood of Enterprise Manager – a Troubleshooting Primer.  We’re hoping to get a Hand on Lab set up for EM as well, still waiting for word on that!

Besides, who doesn’t love a few days in Las Vegas?   This year the conference is at Mandalay Bay, which is where my husband and I got married almost 12 years ago. Hoping to get him to join me for a few days if we can line up a sitter!

That should be enough for this Spring right??  At least for me it is!

Creating EM Users for Performance Tuning

One of the key features for Database administration in Enterprise Manager 12c is the Performance pages utilizing the Diagnostic and Tuning packs. The DBAs are very familiar with these. Many customers are starting to ask how to let their Developers access the performance data without allowing full access to production.

Database Authentication

Even if a user has Super Admin permissions in EM, it doesn’t grant them access to the database target at all. With View Target permission on a database target, a user can get to the main target screen, as seen below:

dbuser1

As soon as they try to dig further into the SQL or Schema, they will be presented with a login box.

dbuser2

The EM user must have Connect/Connect Target Read-only privilege to get a login prompt to a target.   You can either use a Named credential, or create a New credential.  If the EM user has access to Named credentials, they will be able to save the credential and set that as a Preferred credential for this target.  If the Preferred credential is set, the login will be automatic from now on.

From here, what the user can do is completely dependent on what that login was.   Do you have sys as sysdba logins?  If so, you can do just about everything.   Or do you have a restricted read-only database account that limits your actions?   Whatever database account permissions were set are still enforced through EM.   So the question is… what permissions do you need?

Database Authorization

As with any user account in an Oracle database, you have to specify explicit privileges or roles to be able to access certain pieces. Just as you would have to grant select on X table, you have to grant access to specific performance views and functions.

Performance Views

For basic view permissions on the Performance pages, the user needs at a minimum create session and select any dictionary.  If you were able to login, then you already have create session.   So let’s grant select any dictionary.

SQL> grant select any dictionary to scott;

Now when we go to the Performance Home page, we will see the data as below:

dbuser6

AWR

That works great for the Performance pages, but  let’s say you want to run an AWR report, can we do that?

dbuser3

Nope.  As you can see, we get an error that execute privilege on DBMS_WORKLOAD_REPOSITORY is required for this function.  So let’s grant that:

SQL> grant execute on dbms_workload_repository to scott;

dbuser4

Now you can successfully run ASH and AWR reports from EM.

SQL Access Advisor

SQL Access Advisor has additional permissions at the database level that are required.  SQL Access Advisor also submits a DBMS Scheduler job on the database, so we also need access to create jobs.  Without this persmision you’ll get an error as follows:

dbuser5

SQL> grant oem_advisor to scott;
SQL> grant create job to scott;

Now when we submit the SQL Access job, we get a Confirmation message that links to the Scheduler Job :

dbuser7

 

 SQL Tuning Advisor

For SQL Tuning Advisor, you’ll need to create a SQL Tuning Set and have permissions to dbms_workload_repository and administer the SQL Tuning sets.

SQL> grant execute on dbms_workload_repository to scott;
SQL> grant administer sql tuning set to scott;

Once you have these additional permissions, you’ll be able to successfully create a SQL Tuning Advisor job and receive the results.

dbuser9

 

These are some of the more common performance tuning privileges required to use the features through EM, however there are a lot of other features that could be accessed.   Depending on what functions the user requires, you may need additional permissions at the database level.    For additional privileges required, see Where to Find Information About Performance Related Features (Doc ID 1361401.1).

Hopefully this short blog will help you start to think about what roles and permissions your database users might need in order to make full use out of the Oracle Enterprise Manager Performance pages!

ECO 2014 – Zero to Manageability

I had the pleasure of presenting to the East Coast Oracle Users Group conference in Raleigh, NC on November 4th.  I had a great crowd with lots of interest and great discussions! Thanks to everyone who attended today! Slides can be downloaded here.

**Sorry for the delay, WordPress wouldn’t let me post links or images, and finally had time to sort it out! **

Notifications for Expiring DBSNMP Passwords

Most user accounts these days have a password profile on them that automatically expires the password after a set number of days.   Depending on your company’s security requirements, this may be as little as 30 days or as long as 365 days, although typically it falls between 60-90 days. For a normal user, this can cause a small interruption in your day as you have to go get your password reset by an admin. When this happens to privileged accounts, such as the DBSNMP account that is responsible for monitoring database availability, it can cause bigger problems.

In Oracle Enterprise Manager 12c you may notice the error message “ORA-28002: the password will expire within 5 days” when you connect to a target, or worse you may get “ORA-28001: the password has expired”. If you wait too long, your monitoring will fail because the password is locked out. Wouldn’t it be nice if we could get an alert 10 days before our DBSNMP password expired? Thanks to Oracle Enterprise Manager 12c Metric Extensions (ME), you can! See the Oracle Enterprise Manager Cloud Control Administrator’s Guide for more information on Metric Extensions.

Read more here

Getting Ready for OpenWorld 2014

This is going to be a busy month as I finish up presentations for multiple sessions at OpenWorld 2014.  It’s always such a great event, but a lot of work in September!

There’s a lot of valuable EM sessions that you can find here, but I’m going to highlight a few of the ones I’m working on with my team.

Zero to Manageability in One Hour: Build a Solid Foundation for Oracle Enterprise Manager 12c [CON8134]

Wednesday, Oct 1, 12:45 PM – 1:30 PM - Moscone South – 303
Speakers: Courtney Llamas (Oracle), Kellyn Pot’Vin (Oracle),  Dan Brint (SUNY)

We’re calling this our EM 101.  While we will have to skip a lot of the basic information due to the shorten sessions, this is geared towards those who are installing or upgrading to EM 12c and would like to learn from our experience with our “Fast Track” Methodology.   Even if you’ve already implemented or upgraded, you might learn a thing or two about organizing targets or managing your EM system.  We will also save some time for one of our customers (State University of New York) to share their experience in this process.

Abstract: Learn how to properly architect and deploy your Oracle Enterprise Manager 12c implementation, including designing for high availability and scalability. This session focuses on the essential tasks an implementation team must do to ensure Oracle Enterprise Manager 12c rollouts occur in a timely fashion and deliver a solid foundation for exploiting the marquee features of Oracle Enterprise Manager 12c. Topics such as users, roles, groups, templates, and incidents are discussed, plus key architectural decisions. The Strategic Customer Programs team in Oracle Enterprise Manager Development works with customers worldwide to guide them to success with their implementations and has compiled some essential techniques and tips for getting from zero to manageability in the shortest time possible. 

Under the Hood: Diagnosing and Troubleshooting Oracle Enterprise Manager 12c Release 4 [CON8225]

Monday, Sep 29, 1:30 PM – 2:15 PM - Moscone South – 302
Speakers:  Werner DeGruyter (Oracle), Andrew Bulloch (Oracle)

This is our “graduate level” class.  For the people responsible for EM day by day, who have to troubleshoot performance issues or agent issues, this session is for you!  Don’t miss out.

Abstract:  This session equips attendees with the knowledge they need in order to understand the health and status of Oracle Enterprise Manager. It covers essential background information on the Oracle Enterprise Manager infrastructure (such as the repository and the agent) and selected managed targets. Building on this knowledge, the session then looks a little deeper and discusses techniques and tips for monitoring the performance of Oracle Enterprise Manager and tuning any bottlenecks that are commonly identified in Oracle Enterprise Manager. It also explores the essential parts of the Oracle Enterprise Manager UI every Oracle Enterprise Manager administrator should be familiar with and discusses some techniques for logging and tracing to assist in diagnosing problems.

Wait, there’s more!

In addition to the sessions above, I’ll be co-presenting with a few customers on their sessions, so come see how real customers are using EM to manage and monitor their targets!

Advanced Diagnostics and Monitoring with Oracle Enterprise Manager 12c [CON4114]

Thursday, Oct 2, 10:45 AM – 11:30 AM - Moscone South – 301
Speakers:  Tyler Sharp (Cerner), Aaron Rimel (Cerner), Courtney Llamas

Abstract:  This session covers how Cerner Corporation, a leading healthcare IT company, leverages Oracle Enterprise Manager 12c for database-specific thresholds, creating proactive monitoring of 26,000+ targets. Learn how to scrape Automatic Workload Repository data combined with Oracle Enterprise Manager repository data, exploiting common script issues in a homogeneous environment or personalized thresholds with historical data to proactively alarm, hours or even days before a potential outage. Report on compliance to feed management data on complexity and compliance of your data centers. With metric extensions, Cerner realized a 40 percent reduction in patient hours affected. Increase returns on your Oracle Enterprise Manager investment, and move your organization to proactive smart alerting.

Using Oracle Enterprise Manager to Deliver Multitenant DBaaS on Oracle Exadata: Lessons Learned [CON5875]

Tuesday, Sep 30, 5:00 PM – 5:45 PM - Moscone South – 301
Speakers:  Manish Shah (Hartford), Brian Bennett (Hartford), Courtney Llamas

Abstract: Have you migrated to or are you planning to migrate to Oracle Enterprise Manager 12c? Want to know how to automate repetitive tasks and categorize and auto-assign targets to customized monitoring and alerting groups based on bronze, silver, and gold definitions in your DBaaS catalog? This session shows how to build an Oracle Enterprise Manager 12c framework aligned with your organizational model to manage targets on various platforms such as Oracle Database 12c pluggable and container databases. You’ll also learn how to optimize these targets on Oracle Exadata with a combination of administrative and privilege propagating groups, target properties, monitoring templates, and enterprise rule sets, resulting in a flexible yet scalable operational setup for your DBaaS offerings.

Full Visibility into Oracle WebLogic/Java Diagnostics with Oracle Enterprise Manager 12c [CON5983]

Monday, Sep 29, 5:15 PM – 6:00 PM - Moscone South – 200
Speakers:  Mark Consoles (Omgeo), Eldad Ganin (Omgeo), Avi Huber (Oracle)

Abstract: In this session, hear how Omgeo’s application team has leveraged Oracle Enterprise Manager Cloud Control 12c to streamline monitoring and management of its Oracle WebLogic Servers, JVMs, Oracle iPlanet Web Servers, and more to ensure that it can maximize the visibility and reliability of the company’s application systems built on Oracle technology to their fullest extent. By leveraging JVM Diagnostics and Oracle WebLogic monitoring to pinpoint and isolate problems in product environments without having to reproduce them in a test environment, Omgeo has been able to cut down its root cause analysis by orders of magnitude

 

Organizing Your Oracle Enterprise Manager Targets

If you’re monitoring more than a handful of servers or databases in your Enterprise Manager 12c (EM), you have probably started creating groups to manage many targets together.   If you haven’t, this is one of the most critical aspects of setting up your EM to properly monitor and manage targets.  There are several use cases where you will want to perform a single action on multiple targets.

  • Setting monitoring thresholds
  • Granting privileges
  • Sending notifications
  • Applying compliance rules
  • Viewing dashboards
  • Running jobs, upgrades, backups
  • Creating reports

Continue reading Organizing Your Oracle Enterprise Manager Targets

EM12c Release 4: Using Repository Side Metric Extensions to Alert on Collected Metrics

A few weeks ago, someone asked on the OTN forums how to alert on some of the JVM metrics such as ‘JVM Threads – Threads Started (since startup)’ using Enterprise Manager 12c (EM).    This is one of those few metrics that EM collects, but does not allow custom thresholds.    Let’s take a look at the metrics that EM collects on the WebLogic Server target.

Select WebLogic Server / Monitoring / All Metrics

metric1

From here we can scroll down to the JVM Threads section and find the real-time data (by click on the category JVM Threads).  The real-time data is not stored in the EM repository.  Let’s continue to drill down by clicking on the specific metric, JVM Threads – Threads Started in this case.

metric3

This shows us the data as of the last collection, the chart shows the history, and if you click on the link Table Data you’ll get a nice chart with timestamps and values.

metric4

Now let’s take a look at the Metric & Collection Settings page to see what the thresholds are set at.

Select WebLogic Server / Monitoring / Metric & Collection Settings

On the Metrics tab, click the view drop down and select All Metrics, and scroll to the JVM Threads section.

metric2

As you can see there’s no threshold setting for JVM Threads – Threads Started (since startup).  In fact, you can not add a threshold to this particular metric.   Why not?  Who knows.   But that’s not going to stop us.

At the time I the only option was to create a Metric Extension to collect this data from the JVM and then store it as a metric and set your thresholds.  I referred to one of my previous blog posts showing how to create a Metric Extension on Fast Recovery Area.   With the release of EM 12.1.0.4 you can now create a Repository-side Metric Extension to alert on the already collected data!  This Metric Extension uses a query to pull data from the repository, and then you can manipulate that as needed.    No more re-collecting data just to trigger an alert!

Select Enterprise / Monitoring / Metric Extensions

metric5

On the Metric Extensions page, select Create / Repository-side Metric Extension.

metric6

Select the target type, in this case we select Oracle WebLogic Server. Enter a metric name, display name. and adjust collection schedule. Since our metric we’re going to use is collected every 30 minutes, we’ll use that schedule as well.   Click Next.

metric7

Next you will enter the SQL to obtain the metric.  This is where your EM Repository skills will be put to the test.   The following query will find the current (last collected) metric information for the WebLogic Server target type and the specific metric we are interested in.    Be sure to read the tips and examples on the right side for more detailed queries.

SELECT target_guid,value as JVMThreadsStarted
 FROM   mgmt$metric_current
 WHERE  target_type = 'weblogic_j2eeserver'
 and metric_name='jvm_threads'
 and metric_column='totalStartedThreadCount.value'

Click Validate SQL to verify, and click Next.   EM will pre-populate the required columns based on the query you provided.   If you select the row JVMThreadsStarted and click Edit, you can now set a category or set default thresholds.  This particular metric may not be a good example for default thresholds as it could be very target specific.   In this example, we will go ahead and set the defaults.   If you don’t set thresholds here, you can add them at the target level.  After editing click OK and then click Next.

Next we have the chance to Test our metric against a selected target. Click Add, select a WebLogic Server, and click OK.  Then click Run Test.  You will then see in the bottom pane, the results of your metric test.

metric10

Verify that your results are as expected, and click Next .  You’ll be presented with a Review screen before clicking Finish to complete your Metric Extension.

metric23

Once created, select your Metric and click Actions / Save as Deployable Draft.   Then select Actions / Deploy to Targets and select a test target or two that you can deploy to.   Once you’ve tested successfully, select Actions / Publish Metric Extension and start adding your metric to templates.

By going back to the Oracle WebLogic Server target I deployed to, and viewing Monitoring / All Metrics, I can now see my Metric Extension and that it’s already generated a Critical threshold violation.  Be patient, it may take a few minutes to update the status once metric is deployed.

metric24

If you’re not on 12.1.0.4 yet, you’ll need to create a Metric Extension and select target type Oracle WebLogic Server, and use a Mbean browser to find the metric you’re interested in.  In this case, the Metric = java.lang:type=Threading and the Column Order = TotalStartedThreadCount.

metric23

For more details on using Metric Extensions and their life cycle, see the Enterprise Manager Cloud Control Administration Guide section on Using Metric Extensions.

Enterprise Manager, Oracle and other bits of life.