Speaking the language of business intelligence with an Australian accent

Showing posts with label SQL Server. Show all posts
Showing posts with label SQL Server. Show all posts

Friday, November 13, 2009

Who let the Bulldog out?

bulldog

‘member what happened when Microsoft said “Hey, let’s bundle a reporting engine into the SQL Server license”, “Hey let’s bundle an OLAP engine into the SQL Server license”, “Hey let’s bundle an ETL engine into the SQL Server license”? Well, they’re doing it again.

The other day I downloaded and installed the latest CTP of SQL Server 2008 R2. Although there are plenty of good things to talk about in this release the one that really interests me (and many others) is Master Data Services or MDS, originally codenamed “Bulldog”. Once again Microsoft is being disruptive by bundling yet another <InsertNameHere> Services product into the SQL Server stack.

MDM is Enterprise only. Not for long…

In its magic quadrants, Gartner splits analysis of Master Data vendors into Customer and Product master data categories. Their analysis of MDM players contains vendors that are very much enterprise focused and don’t sell huge volumes of licenses. Many of these vendors reference Fortune 500 companies as their customers. This reinforced by belief that MDM is very much an enterprise only playground. The license and maintenance revenue from small volumes of customers is enough to sustain these vendors’ business models. Translation: big license fees & big maintenance fees. I’m sure the products are worth every penny, but not every business can justify spending big money on buying and implementing MDM.

Companies that deal with hundreds of thousands, or even millions, of different SKUs or unique customers need a way to manage that one version of the truth for their incredibly large and complex global businesses. This is fine for those that can justify spending the amount of money needed to accomplish this, but what about the company with just 500 SKUs and 10,000 customers? They may still have tons of money, hell they my even be Fortune 500, but they may not have mountains of master data records to manage. Even the most cashed up companies would think twice about spending vast sums of money on ways to manage small volumes of critical master data. IMO the enterprise vendors are not interested in these companies and these companies are not interested in enterprise vendors.

Enter MDS. Cost? Included in SQL Server license.

The Incumbents

I’m sure the established players in the MDM space are snickering behind their hands at Microsoft’s audacity in trying to muscle in on the MDM market. They’re already hard at work compiling comprehensive lists of “but does it have…?”, “can it do…?”, “it can’t…” and the ever-popular “C’mon, it’s Microsoft! Wait ‘till SP1 comes out.”

To be sure, there are plenty of good reasons the incumbents have as to why MDS may pale in comparison to their own technology stack. There is no question that MDS will be playing catch up here. Most of the others have been in business a long time and have excellent, very mature products. No argument there. Keep in mind, though, that MDS is also based on a pretty mature MDM product, Stratature, that was acquired by Microsoft in 2007. Nonetheless I’m sure there will not be as many features baked into MDS v1 when compared with the other market players.

The incumbents are focused on the big enterprise fish who have nasty, hairy, complicated master data problems that need to be solved. Of course, that’s their target market. These are the customers who will can (and want to) pay for what the incumbents have to offer. No doubt it’s good stuff, but what about the business who just wants a central place to manage the names and hierarchies of their 100-ish sales territories and their exclusive list of 2,000 customers? Do they need all the enterprise MDM bells, whistles and cost? Probably not. They’ve been making do with Excel. Until now.

Got Lookup Tables?

Raise your hand if you’ve ever created a lookup table that had to be maintained or watched over by someone who is umm, not so technical. If you suggested forking out a large pile of cash to purchase MDM software to assist this non-technical person maintain proper control of small volumes of simple data you were probably laughed at.

“Do it in Excel”, “Create a table in a DB and build a UI for maintenance”, “Use Access…”. These are the thin-end-of-the-wedge scenarios that will allow MDS to gain footholds in places that the other vendors would not even get out of bed for. Like Analysis Services and Reporting Services the barriers of entry for the IT geeks to start playing around with and eventually deploying MDM into production will be drastically lowered.

Don’t get me wrong, there’s still going to be plenty of big, complex enterprise MDM scenarios that MDS will tackle as well. *But* (I think) there is going to be a whole new breed of non-enterprise MDM customer that will start making themselves known very soon.

The 4 P’s of MDM

When you start looking into the world of MDM one of the first things you quickly realize is that the software, while critical to the process, is not even close to the complete solution. Anyone who has been involved with an MDM project will tell you that while good software definitely helps, the real success of a master data initiative is inexorably linked to all of the 4 P’s of MDM:

  • Processes
  • People
  • Politics
  • Product

Notice that product only makes up 25% of this. Figuring out the technicalities how to use MDS is not going to be much of a chore for most BI / IT pros. The real challenge is getting the other 75% of the 4 P’s in place.

MDS, as part of the SQL stack, frees up funds to spend on getting all four P’s right. There is reasonable about of consulting hours that can be purchased with the money saved when you don’t see any increase in SW license costs.

What’s under the hood?

As I get stuck into the internals of the product I will blog more. From what I’ve toyed around with so far the product looks interesting, is simple to set up, and should be pretty easy for both geeks (getting stuck into the DB, web services and API) and the non-geeks (who will use the web-based UI to manage things) to get a handle on. On digging into some of the more complex looking objects within the repository DB and web-based UI you can see that there is a lot of good stuff to explore and experiment with.

Jamie Thompson blogged about his delight in discovering that MDS implements some very cool Regex and Fuzzy lookup functionality. I’m sure Jamie’s next question was whether there are any MDS-flavored custom SSIS transforms or tasks included in the initial release. I asked the same question. Answer: There aren’t any. Yet. The group PM for MDS is Kirk Haselden, you may remember Kirk from such products as SSIS where was the dev manager and one of the product’s primary designers. With Kirk’s involvement you can be pretty damn sure there will be some SSIS goodness that will make its way into MDS at some point in the foreseeable future. For now, though, you can interact with data via the MDS web service, API or just plain ‘ol TSQL. Plenty of options there for SSIS to hook into. More on this as I play around with the product.

Final Thoughts

MDS will go head-to-head with the established enterprise MDM players, no question. In the short term the product will probably not make much headway in that market, though. No surprises there. However, think of what the potential is for businesses that the big vendors don’t care about right now. Those who own SQL Server licenses and have even the smallest requirement for managed master data are all fair game.

Friday, December 15, 2006

BIDS problems related to Office 2007

I have just installed Office 2007 RTM (love it!). Unfortunately the same problem that caused me to revert from the Office 2007 Beta 2 Technical Refresh back to Office 2003 a few months ago is still here. In my case the problem occurs when trying to view MDX in the Calculations tab of an SSAS project in BIDS. I get: Unexpected error occurred: 'Error in the application.' From my understanding there is a mismatch in the versions of some of the SSAS DLLs that causes this. There are several other scenarios in BIDS and SSMS where problems occur, they are documented in this KB article. Brian Welcker also blogged about the B2TR problem a while back with regards to SSRS Designer problems with the same root cause. Unfortunately the hotfix referenced in the aforementioned KB article is only available when you contact MS support directly (someone has to explain the logic behind this for me one day... I don't understand why I can't just download it).

I believe there is a fix for this coming in SQL 2005 SP2 but for those who cannot wait for RTM a viable alternative exists here from Mary Potapova in this post or similarly in Brian's post. The fix is, essentially, making sure the versions of the offending DLLs are the same in a couple of different directories - it worked for me. The usual warnings apply here when copying and pasting different versions of DLLs around the place.

UPDATE: Darren Gosbell blogged about this very problem (and the solution) back in mid Nov. For some reason I completely forgot that I had read his post on this. I'm getting old.

Tuesday, December 5, 2006

The Rational Guide to BSM 2005

At present, counting the number of books dedicated to BSM 2005 is easy: zero. In 2007 that will change. I'm happy to announce that the Rational Guide to Microsoft Office Business Scorecard Manager 2005 will be available very early next year (probably mid to end of January).

During the last couple of months my co-author, Adrian Downes, and I have been putting this book together under the watchful eye of our technical editor, Ian Tien. We hope it will provide a quick, concise guide to those who want to get up to speed on BSM in very little time.

...and now the inevitable question on the tip of your tongue. Kindly allow me to both ask and answer it for you:

"Nick, Adrian, what are you doing publishing a book on BSM now?! PerformancePoint is coming out in around seven months!"

Precisely. A good understanding of how to really make BSM sing and dance now will pay dividends in mid 2007. PP only enhances, improves and extends the ease with which scorecarding solutions can be produced. Prior experience with the design paradigms in BSM will allow new PP designers to hit the ground running, fast. Naturally we have included a chapter on some of the upcoming improvements and changes that will be present in the scorecarding (Monitor) part of PerformancePoint too.

Saturday, November 11, 2006

MCITP BI Exam Prep Guides

The breakdown of requirements for the two MCITP BI exams has been posted on Microsoft Learning. Nothing surprising on the contents of each, really, but it's good to know that things are finally moving forward on the third of the SQL 2005 MCITP certs.

Here they are:

The beta for exam 70-445 has begun so we can probably still expect general release some time early next year.

Thursday, September 7, 2006

At last, a SQL 2005 BI documentation tool!

Since the SQL 2005 release last November we've been hard up to find any doco tools that support SSAS, SSIS & SSRS. There are plenty of RDBMS doco tools but not much (anything?) in the way of a SQL BI tool. Ever since Chris Webb made us aware of BI Documenter in June my colleagues at SDM and I have been working with the developers of this product as we really liked the direction they were headed. We hope that in providing heaps of feedback & ideas we can get a tool that does what we really want. The latest release is well on the way to what we are looking for and supports SSAS and SSIS along with the usual relational DB stuff. Check it out here.

They tell us that future plans for the product include SSRS, data lineage/dependency mapping capabilities and SSIS diagrams. As it stands they have lots of underutilised meta data and are continuing to look for useful things to do with it.

Does anyone know of any other SQL 2005 BI doco tools out there?

Monday, August 14, 2006

SSRS - "Select All" feature to return

A few months ago I blogged about the Disappearing Select All Parameter that happened after applying SP1. Seems that the SSRS team have done an about-face on this change of functionality. There will soon be a hotfix to change the behaviour back to the way it was. The feature will also be put back in the upcoming SP2 (which is due some time in 2007 I believe).

Brian Welker has all the details and the reasons why the decision was made originally and, more importantly, why it will be changed back in this post.

Wednesday, April 19, 2006

SQL Server 2005 SP1 available

SP1 is now available for download.

What am I looking forward to? Not having to be connected to the network in order to browse cubes on my named instance of SSAS.

Sunday, November 20, 2005

SQL 2005 - more on "MS Data Warehouse Toolkit" book

A while back I posted about the upcoming Microsoft Data Warehouse Toolkit by Joy Mundy and Warren Thornthwaite. Well, there has been some movement on the book's official site. Amazon lists the book as coming available on around Feb 10 , 2006. In the meantime the two authors have begun dangling the virtual carrot by posting some useful stuff on the site. There is a dimensional modeling Excel spreadsheet complete with DDL-generating macros, there are also two example SSIS packages and some wizard-built warehouse metadata SSRS reports.

Looks like this is going to be a very hands-on book from The Kimball Group, I believe this will be the first vendor-specific book on data warehousing they have produced. The other Kimball titles I have read have been vendor agnostic. I think it says a lot about the breadth of the new BI capabilities of SQL 2005 if the Kimball Group feel that there can be an entire "... Warehouse Toolkit" flavoured book based on the new product through which they can impart their data warehouse methodology. Looking forward to getting my hands on a copy!

Wednesday, October 19, 2005

SSMS - Comment keyboard shortcut

Unfortunately the T-SQL comment and uncomment keyboard shortcuts in SSMS are now a little more involved, probably as a result of the new consolidated management environment. In (am I allowed to say "Classic" yet?) Query Analyser CTRL + SHIFT + C and CTRL + SHIFT + R would comment and then uncomment the block of selected SQL code. In Management Studio we now need to use CTRL + K then CTRL + C to comment and CTRL + K then CTRL + U to uncomment the selected text. This is a bit awkward but I guess we'll have to get used to it. On the brighter side, this new comment shortcut can be used the same way for SQL, MDX, DMX, AMO and SQL Mobile queries.

The most recent list of shortcuts can be found here. And of course your local copy of BOL.

UPDATE: Thank you to Graham who has corrected me on the shortcuts:

You can go to ToolsOptions... and click on Keyboard underneath Environment. There you have an option to change the keyboard scheme to SQL Server 2000 which will use the "classic" keyboard shortcuts.

If I'd have bothered to read the text at the top of the Keyboard Shortcuts reference page I would not have posted this. Apologies for my laziness...

Monday, October 3, 2005

SQL 2005 - Joy Mundy's book

In a previous post I added a few of my own suggestions to Chris Webb's SQL 2005 book list. Among them was Joy Mundy's upcoming work, The Microsoft Data Warehouse Toolkit. I was told by a friend who recently attended PASS that there will be a site to go along with the book. It looks pretty sparse now but I'm sure, once published (ca end of Jan 2006), the book and the site will have tons of good stuff. I'm really looking forward to getting my hands on a copy. Remember, this is coming from the Kimball Group. If you have never read one of Ralph Kimball's books and you do a lot of data warehousing work you should certainly have a look at The Data Warehouse Toolkit and The DataWarehouse ETL Toolkit - two great books.

Ralph Kimball is the man who pioneered the Slowly Changing Dimension concept (among many others). SSIS now includes a specific transform which makes handling SCDs a breeze. I was really happy to see this transform as part of the product and created a demo package that I sent to Jamie Thomson as I didn't have a blog at the time. Jamie has it posted here.

Saturday, September 24, 2005

More Project REAL stuff

There are a few more Project REAL white papers now available from their site

Among the newer papers are:

  • Predictive modeling using SSAS
  • SSIS Custom Component Development
  • SSAS Best Practices
If you haven't made a visit to the REAL page recently I would thoroughly recommend spending time doing so. Set aside a day or two, though - lots of good stuff there.

Friday, September 23, 2005

SQL 2005 Books

One of my favourite bloggers and MDX guru, Chris Webb, has beaten me to posting a list of some of the most interesting soon-to-be-released SQL 2005 books. He as also listed what I agree are probably the best books on AS2000 and MDX in 2000.

I just wanted to add a couple of others I also have on my Amazon wish list:
Professional SQL Server 2005 Integration Services by Brian Knight
The Microsoft Data Warehouse Toolkit : With SQL Server 2005 and the Microsoft Business Intelligence Toolset by Joy Mundy
Microsoft SQL Server 2005 Reporting Services 2005 by Brian Larson
The Rational Guide to Scripting SQL Server 2005 Integration Services Beta Preview (Rational Guides) by Donald Farmer (got this one a couple of weeks ago - great book!)

I am especially looking forward to the 2nd edition of MDX Solutions which Chris is co-authoring with George Spofford and others. No question that the 1st edition of this book is the AS2000 "MDX Bible". I'm sure the next edition will not disappoint.