• Skip to main content
  • Skip to primary sidebar

DallasDBAs.com

SQL Server Database Consulting

  • Services
  • Pocket DBA®
  • Blog
  • Testimonials
  • Contact
  • About

SQL

Integration Services Catalog package errors

December 31, 2018 by Kevin3NF 3 Comments

Short post today…

My client makes extensive use of SSIS and deploys the packages to the Integration Services Catalog (ISC), and runs them via hundreds of jobs.

When one of the jobs fail, I have to go get the details.

Job History doesn’t have it.

So my process was:

  • Get the package path out of the job step
  • Expand the ISC
  • Expand SSISDB
  • Expand the Folder (get this from the job step)
  • Expand the Projects Node
  • Expand the correct Project (get this from the job step)
  • Expand Packages
  • Right-click the relevant package (get this from the job step)
  • Go to Reports, Standard Reports, All Executions
  • Filter for Failed Executions
  • Cross your fingers that you can get useful info from the result.

Now, repeat for each job step that failed.

The SSIDB database has all of this in the Tables (schema – Internal) and or the Catalog Views.

It took a while, but I created this to run around those tables and views to get ALL of the errors for the last day:

/*

Created by Kevin Hill, Dallas DBAs LLC, 12/28/2018
Inspired by work from Jules Behrens
Index tested by Peter Schott

This queries multiple SSISDB tables to return a clear path from Top to bottom 
related to errors in an Integration Services Catalog based SSIS package.
It has not yet been tied back to job execution, nor is it set to email info out.

Use this as a backup to your normal job failure checks to tie it all together
instead of spending a full cup of coffee clicking and drilling into the cumbersome 
All Executions report.

Free to use and modify, please leave this header as a courtesy.

*/

Use SSISDB
go

Select Distinct
	fold.[name] as Folder_name
	,proj.[name] as Project_Name
	,pack.[name] as Package_Name
	,ops.[message_time]
	,mess.[message_source_name]
	,ops.[message]
	--,mess.[execution_path]		-- this is pretty long path if you are pasting into an email or Excel
From [internal].[projects] proj
	Join [internal].[packages] pack on proj.project_id = pack.project_id
	Join [internal].[folders] fold on fold.folder_id = proj.folder_id
	Join [internal].[executions] execs on 
		execs.folder_name = fold.[name] and
		execs.project_name = proj.[name] and 
		execs.package_name = pack.[name]
	Join [internal].[operation_messages] ops on execs.execution_id = ops.operation_id
	join [internal].[event_messages] mess on ops.[operation_id] = mess.[operation_id]
		and mess.event_message_id = ops.operation_message_id
		and	mess.package_name = pack.[name]
Where 1=1
	and ops.message_type = 120		  -- errors only
	--and mess.message_type in (120,130)  -- errors and warnings
	and ops.message_time > getdate() - 1 -- adjust as necessary

/*
If you have a very large SSISDB due to activity or long retention, please consider this index:

CREATE NONCLUSTERED INDEX [NC_OpsID_MessageType_MessgeTime] ON [internal].[operation_messages]
(
	[operation_id] ASC,
	[message_time] ASC,
	[message_type] ASC
)
INCLUDE ([message])

*/

If this is useful for you, please rate it on the TechNet Gallery where I posted it.

If you have a very active server, this can take awhile as the indexes on the underlying tables are for the cascading delete cleanup process.  I’m working on a set of good indexes that will likely be unsupported by Microsoft, but useful.

Adjust as you see fit.  Please leave the header if you use it.

Thanks for reading!

Kevin3NF

Follow @Dallas_DBAs

—————————————————————-

Filed Under: SQL, SSIS, TSQL

DBA Fundamentals pre-cons 2019

November 12, 2018 by Kevin3NF Leave a Comment

While this post is for everyone, it is specifically written for  SQL Saturday organizers…

I am filling out my 2019 schedule of target dates/locations of SQL Saturdays I want to attend/present (US only…I don’t even have a passport)

I am offering to do my DBA Fundamentals pre-con and one or two Saturday sessions (Security/DR) with a twist:

You keep my part of the pre-con proceeds for your group.  I’ll cover my own travel, meals, etc. if you provide the space.  This should allow you to increase your funding for the rest of the event, buy some pizza for your local group, or even discount the pre-con price should you choose to do so.

If you only have 1 or 2 pre-con spots and cannot secure an additional room at your venue, please pick from the other submissions 🙂

Tentative schedule:

  • January –
  • March – Chicago (23rd, submitted) or Cincinnati (30th)
  • April – Dallas *
  • June –
  • August –
  • October –
  • December –

* All of these are tentative, some dates not granted yet

So, dear organizer…if you think this offer will be a benefit to your SQL Saturday, please get in touch and let me know what your planned date is so I can be sure to submit.  [email protected]

Thanks for reading!

Kevin3NF

Follow @Dallas_DBAs

Filed Under: Accidental DBA, Beginner, SQLSaturday, Training

PASS Summit 2018 – My Schedule

November 6, 2018 by Kevin3NF Leave a Comment

If you are going to PASS Summit in Seattle and want someone to sit with, check out my schedule (primary and backup sessions) – very much subject to change:

 

Wednesday, November 7, 2018

============================

10:15 AM – 11:30 AM Room: 2AB

dbatools Powershell Library – The Complete Introduction (Yes, my very first session is Powershell, lol)

https://www.pass.org/summit/2018/Sessions/Details.aspx?sid=85712

10:15 AM – 11:30 AM Room: 612

Uncovering Duplicate, Redundant, & Missing Indexes

https://www.pass.org/summit/2018/Sessions/Details.aspx?sid=77036

1:30 PM – 2:45 PM Room: 606

Improving Availability in SQL Server and Azure SQL Database

https://www.pass.org/summit/2018/Sessions/Details.aspx?sid=84728

1:30 PM – 4:00 PM Room: 6E

SQL Server Migrations Done the Right Way

https://www.pass.org/summit/2018/Sessions/Details.aspx?sid=84219

4:45 PM – 6:00 PM Room: 6A

SSMS & T-SQL Tricks: Working Smarter, Not Harder

https://www.pass.org/summit/2018/Sessions/Details.aspx?sid=78153

Thursday, November 8, 2018

============================

10:45 AM – 12:00 PM Room: 6B

Containers, Pods, and Databases- The Future of Infrastructure

https://www.pass.org/summit/2018/Sessions/Details.aspx?sid=78022

1:30 PM – 4:00 PMRoom: 606

Query Tuning Internals for the Advanced SQL Developer

https://www.pass.org/summit/2018/Sessions/Details.aspx?sid=78050

1:30 PM – 2:45 PM Room: TCC Tahoma 2

Top 5 Power BI Custom Visuals

https://www.pass.org/summit/2018/Sessions/Details.aspx?sid=82110

1:30 PM – 2:45 PM Room: 6C

Top Tips for Deploying AGs and FCIs On Premises or In the Cloud

https://www.pass.org/summit/2018/Sessions/Details.aspx?sid=78041

3:15 PM – 4:30 PM Room: 618

An Introduction to Partitioning

https://www.pass.org/summit/2018/Sessions/Details.aspx?sid=77002

4:45 PM – 6:00 PM Room: 604

Data Science 101 for the SQL DBA

https://www.pass.org/summit/2018/Sessions/Details.aspx?sid=86521

4:45 PM – 6:00 PM Room: 6C

Validate Your SQL Server Estate with Ease Using dbachecks

https://www.pass.org/summit/2018/Sessions/Details.aspx?sid=78382

Friday, November 9, 2018

============================

8:00 AM – 9:15 AM Room: 6C

T-SQL Habits and Practices That Can Kill Performance

https://www.pass.org/summit/2018/Sessions/Details.aspx?sid=78111

9:30 AM – 12:00 PM Room: 6E

Migrating to SQL Server 2017

https://www.pass.org/summit/2018/Sessions/Details.aspx?sid=78285

11:00 AM – 12:15 PM Room: 3AB

BI Power Hour

https://www.pass.org/summit/2018/Sessions/Details.aspx?sid=86517

2:00 PM – 3:15 PM Room: 3AB

Lightning Talks: DBA

https://www.pass.org/summit/2018/Sessions/Details.aspx?sid=85592

2:00 PM – 3:15 PM Room: 618

What’s New With Adaptive Query Processing?

https://www.pass.org/summit/2018/Sessions/Details.aspx?sid=78238

3:30 PM – 4:45 PM Room: TCC Yakima 1

A DBAs Guide to the Proper Handling of Corruption

https://www.pass.org/summit/2018/Sessions/Details.aspx?sid=78274

3:30 PM – 4:45 PM Room: TCC Tahoma 4

SQL Server Performance Monitoring Made Easy

https://www.pass.org/summit/2018/Sessions/Details.aspx?sid=85138

 

PLEASE feel free to come introduce yourself like we are old friends.  My brain is defective in remembering names and where we met, so you may have to remind me if in fact we have met before 🙂  Fair warning…I may ask you to take a selfie with me.  I suck at selfies so I may actually get a shot of your shoes, or the ceiling 🙂

Thanks for reading!

Kevin3NF

Follow @Dallas_DBAs

Filed Under: Career, Summit, Training

SQL101: Import/Export wizard

September 13, 2018 by Kevin3NF Leave a Comment

Do you need to quickly Import or Export data to/from SQL Server?  Do you want to avoid the hassle of creating and deploying an SSIS pacakge?

The SQL Server Import/Export wizard might be perfect for you!

The wizard steps you through the necessary pieces and is surprisingly flexible.  I cover the basics in this video (recorded in one shot, please excuse throat clears and “Ums”)

If you have comments, please leave them on the YouTube page (ideally) or down below.

Its very likely this is part 1 of at least two…trying to keep my videos to shorter lengths.

Thanks for reading!

Kevin3NF

Follow @Dallas_DBAs

Filed Under: Accidental DBA, Beginner, SSMS

Getting Started with Index and Execution Plan Basics

August 24, 2018 by Kevin3NF Leave a Comment

If you are a developer or new SQL Server DBA and have never really worked with query tuning, this post is for you.  If you are an experienced DBA/Tuner and want to nit-pick me saying field vs. column, feel free to leave a comment that I will delete or never publish, lol.  This is basics, yo…

I concentrate on how to measure the performance of a query, as well as the basics of “seeing” how SQL Server is executing the query to return the results.

I could type all of this up, but watching the video is going to be a WHOLE lot better teacher, so here you go:

As always, feel free to reach out via the comments here or on the video.  Or, follow me on Twitter and ask away!

Thanks for reading!

Kevin3NF

Follow @Dallas_DBAs

Filed Under: Accidental DBA, Beginner, Indexing Strategies, Performance Tuning

T-SQL Tuesday: Brick walls

August 14, 2018 by Kevin3NF 1 Comment

T-SQL Tuesday is a monthly blog party for the SQL Server community. It is the brainchild of Adam Machanic (b|t). This month’s edition is hosted by Wayne Sheffield (b|t) who has asked us to tell a story about a time we ran into a Brick Wall.

So many walls, so few Bulldozers…

The largest brick walls I’ve ever run up against were not technical issues as you might expect…but people and processes.

Processes:

I was working for a company that bought a company that bought the company I had hired on with.  The newest owner was growing their managed hosting business by buying others out.   Not a bad approach when you have deep pockets.  BUT, they never integrated any of them.  Everything was still in its original silo.  So, anytime I got a call or a ticket, I had to search through 4-5 knowledge base/Sharepoints, 2-3 password repositories and 4 ticketing systems.  I could easily spend 2 hours to research and close a ticket that took 3 minutes to resolve on the technical side.

This place broke my flipper.  As in, I no longer gave a flip after it took a full year to get all the access I needed to every environment.  The Bulldozer here is that I got laid off.  They gave me a big bag of money to leave and go do cool things with modern SQL versions for other places.  YES!!

People:

I was asked to bill a crazy high rate for a full-time contract, to watch over a very small environment of 25 servers.  I was asked to put in best practices, be the unofficial team lead, make things go faster, secure them, etc.

BUT…JimBob the Manager (clearly not his real name) gave me the brick wall at every turn. It took 6 weeks to get rid of NetBackup in favor of SQL Server Maintenance Plans. (I know…lets not go there.).  Compressed backups?  Made me prove it.   Index maintenance?  OK, but he wouldn’t let me schedule it.  New indexes that actually made sense?  No chance, as that was a code change to the application our Very Big Vendor had written for us.  Within 3 months, I was down to 15 minutes of real work a day, and the rest spent blogging, Tweeting and answering questions on DBA.StackExchange.

The Bulldozer on this one was me walking out the door into cooler things.  33% pay cut was worth it, to save my sanity and go independent again!

Technology:

I don’t run into technical Brick Walls, because I know how to Tweet using #sqlhelp, as well as read blogs from people I trust in the #sqlCommunity, and Vendor docs.

Thanks for reading!

Kevin3NF

Follow @Dallas_DBAs


Filed Under: Career, TSQL

  • « Go to Previous Page
  • Go to page 1
  • Interim pages omitted …
  • Go to page 22
  • Go to page 23
  • Go to page 24
  • Go to page 25
  • Go to page 26
  • Interim pages omitted …
  • Go to page 37
  • Go to Next Page »

Primary Sidebar

Search

Sign up for blogs, DBA availability and more!

Home Blog About Privacy Policy
  • Home-draft
  • Blog
  • About Us

Copyright © 2026 · WordPress · Log in

 

Loading Comments...