Friday’s keynote was delivered by Microsoft’s Mark Souza and gave an insightful rundown of some new features coming in the next release of SQL Server codenamed Denali, there were some interesting High Availability and Disaster Recovery (HADR) features, a new Column Store styled index, the new data visualisation / dashboard tool Crescent as well as some additional enhancements that sound minor but will probably yield a large benefit (Windows Core support, Contained Databases, FileTable).  Also sharing the stage with Mark was David Flynn, CEO of Fusion-IO who gave a short but interesting overview of their ioDrive product which can provide amazing performance increases by moving IO bottleneck from the SAN onto NAND Flash directly attached to the PCI Express bus – though some nearby graffiti (pictured) showed that there’s still some loyalty to old storage media!

My top talks of the weekend included Jamie Thompson‘s session on SSIS Performance and Vincent Rainardi‘s talk on Advanced Dimensional Modelling but my ‘best of show’ goes to Martijn Evers’ talk on Data Vault – a data modelling technique that complements use of the well established Kimball and Inmon approaches to data warehousing.  I took a lot of useful hints, tips and tricks away from many of the talks I attended but the Data Vault talk gave me something much more valuable – an entirely new idea, something I’d never heard before but will make me think about data modelling in a slightly different way.  It’s the inclusion of these satellite topics (i.e. not directly related to SQL Server) that really makes SQLBits stand out and one of the reasons I keep coming back.  Aside from the talks my other highlights were sitting on the beach eating lunch and getting my first go on the Xbox 360 Kinect!

It’s worth mentioning that the entire event couldn’t happen without the sponsors and in particular I think a lot of good will should be shown to Microsoft.  Windows users tend to see them as a giant corporate entity that they never get to interact with but somehow it’s different in the SQL Server product team and they make a lot of effort drafting in some of their best people including Thomas Kejser, Ewan Fairweather, Lubor Kollar, Mark Souza, Connor Cunningham and Andrew Fryer (who completely schooled me on Kinect boxing).  Many of these guys fly in from the US and of course Microsoft can afford it but the point is that they don’t make a big deal out of it, these guys run sessions and wander around conference offering support to anyone that asks – where else do you get that?

There’s nothing quite like listening to a talk from someone who’s utterly engaged in what they do and wants to share the information with others and that’s what SQLBits is all about so if you’re a SQL Server developer or DBA you just have to go, it’s that simple but if even you’re a .NET developer or work with other database and BI products it’s well worth attending – for now I’ll look forward to seeing you all at the next SQLBits.

I just wanted to give people a head’s up – SAP are running a “Launch Event” for the upcoming 4.0 releases of their BI and EIM tools in London on the 7th of April, I’m assuming that this is going to be the release of the XI 4.0 product though there could be a change in branding to remove the ‘XI’ portion and fall more in line with SAP’s naming conventions.  I’ve not seen much in the way of expected features so it’ll be an interesting event I expect, most of the speakers are unfamiliar to me although I’ve seen Richard Neale speak at a number of BOUG (Business Objects User Group) events and he always comes across confidently gives a compelling view of the product.

One thing that is clear is that there’s definitely some coming together of traditional SAP products and the Business Objects line, if nothing else the sponsors/exhibitors bear that out pretty clearly with the inclusion a few ‘big guns’ such as Atos Origin and Cap Gemini as well as some smaller SAP specialists like Bluefin and Edenhouse.

In terms of what to expect, that’s tough – there’s going to be a lot of emphasis on shiny new features such as Mobile BI, advanced dashboarding and data visualisation but that’s not what I’m there to see.  I’m really hoping for a slicker version of Web Intelligence, less fiddly and more intuitive – you can achieve a lot in the current version of WebI but the interface feels a little dated when compared to many of today’s web tools.

The lag between cloud and in-house software suites is something I think all BI vendors suffer from and it will be a tough problem to solve.  Cloud services are able to evolve continually whilst installed applications represent a snapshot of the industry’s ‘state of the art’ at the time of release and large corporate installations will almost always be 1 or 2 versions behind the bleeding edge.  This never used to be much of a problem but now most users are familiar with rich interactive web tools such as Google Docs, Mobile Me, Nike+ and Garmin Connect – now when your users come into the office they have certain expectations and at the moment I think many BI tools fall somewhat short either in functionality or ease of use.  On a related note I also expect to hear more too about potential cloud offerings from SAP or SAP partners.

Whatever happens I’m sure it will be an interesting day and of course I’ll post an event wrap-up for those of you that can’t attend, if you feel like coming along you can register at sapevent.co.uk/4launch and perhaps I’ll see you there.

The second talk was Matt Whitfield‘s ‘CLR Demystified’ and not being a developer I’ll admit that much of it went over my head but I get the basic principles and most importantly I know what’s possible and where I might make use of CLR. The most interesting avenues for me are the ability to write custom aggregate functions and define custom data types – I was also impressed with the opportunity to increase performance in certain text processing / forward log parsing situations.

The next talk I attended was a gentle introduction to PowerShell and James Boother did a good job of showing where it might be useful for admin tasks, in particular the example of purging old backup/log files based on age lit my eyes up. There was also a demo of PowerShell authenticating with Twitter and posting tweets as admin alerts, alas the demo failed but that could well have been a timeout on the Uni’s WiFi network or just plain old demo-gremlins. I must say thou that I still can’t view PowerShell with some sense of disappointment because with all it’s flexibility and power it’s so damned wordy and many of the tasks it performs could be achieved with less code that a good old Bash script.

As with Friday I attended Quest‘s lunchtime session run by Kevin Kline, Ian Kick, Brent Ozar and Buck Woody – they’re some of the most experienced guys in the SQL community and when you get them together they’re funny as he’ll too so I was both entertained and informed in their myth-busting quiz.

My first afternoon talk was Gary Short’s session on NoSQL which predictably sparked a few polite but irate rebuttals from argumentative DBAs but the session itself was an excellent whistle-stop tour of the predominant NoSQL technologies and use cases. I was encouraged to hear from someone experienced in the field that nobody has quite put together all the pieces to hook up BI tools (that traditionally expect relational/dimensional models or OLAP sources) to the NoSQL back-ends, it’s a shame since I might need to do so pretty soon – I guess I’m going to have to get my hands dirty then!

The final talk was from Kevin Kline of Quest who covered SQL Injection, it was an informative talk that gave me pause for thought about a couple ‘best practices’ that I probably ought to harden a little. Kevin recommended a few tools that I’ll definitely be checking out at some point, notably:

• HP Scrawlr
• URLScan
• Source Code Analyser for SQL Injection
• Assessment and Planning Tool
• Discovery Wizard

And a few handy sites/articles:

• SQLSecurity.com
• MSDN ms161953
• MSDN ms998271
• ferruh.mavituna.com

Once more it was a great conference and the free day was every bit as good as the paid day, I can honestly say that I walked out of the event already looking forward to the next one.

It’s always a tough choice picking which sessions to attend so it’s often best to go with speakers you know will be good so despite having spent the entire previous day with Maciej Pilecki in the SQLBits Training Day I made my first session Maciej’s SQL Server Statistics talk.  Despite a few initial technical gremlins the talk went well and gave a few insights into how statistics are used by the query optimiser with the key takeaways being to always keep both AUTO_CREATE_STATISTICS and AUTO_UPDATE_STATISTICS turned on, to consider turning on AUTO_UPDATE_STATISTICS_ASYNC (does not force queries to wait for stats to be updated but subsequent queries will benefit) and to run sp_updatestats after any major updats or to reindex your tables periodically.

My next session was Brent Ozar‘s Virtualisation and SAN talk, this gave me a whole load of questions to go back to my SAN Administrator with as well as a whole load of tests I intend to perform before I deploy my next Data Warehouse on a Hyper-V guest.  One concept that was completely new to me was the Balloon Driver that hypervisors use to encourage Windows to free-up RAM, since SQL Server is a good citizen it can end-up flushing the entire Buffer Pool and wrecking your performance – the solution is to ensure that Dynamic Memory is disabled in the Hyper-V Manager.  Some great related resources can be found at…

• BrentOzar.com/go/SAN
• BrentOzar.com/go/PerfMon
• BrentOzar.com/go/SQLIO

The lunchtime sponsor talk I chose was the one from Quest that covered IT Horror Stories, it was a brilliant session with plenty of audience interaction and steered clear of pimping any specific Quest products but instead just showed that the people that work there are experienced, pragmatic and generally just nice guys.  I think this approach is far better than the extended product demos that many software companies tend to give as their lunchtime sessions as they’ll only be of interest if you’re genuinely considering the product and if you’re not they’ll do little to increase brand awareness with a room full of bored people on Twitter of Facebook.

After lunch I went for Buck Woody‘s talk on Business Continuity which provided a few simple paths and the crucial tasks to help get people started on a business-relevant disaster recovery strategy.  I was particularly impressed with one of the central themes of the talk which was (I’m reading between the lines a little) that even if you think it’s ‘not your job’ to put a DR plan in place, it’s likely that as the company’s ‘Data Professional’ people will still look to you in times of failure and if you’ve already done all of the planning you’ll be the guy with a calm head solving the problem and if you’re not that guy – start getting your CV ready.  Despite having heard the name and having read a few of his blog posts over the years I’d never heard Buck speak and he’s great so if you get the chance to see him you definitely should.

Well that wraps-up the day nicely, I’ll be posting Saturday’s round up soon after I’ve written it!

Choosing one of the courses was quite an ordeal and I was very tempted by Brent Ozar‘s Virtualisation and SAN course, part because having seen him before I know he’s a great speaker and also because it’s going to be directly relevant to my work very soon.  In the end I chose Maciej Pilecki‘s course on the SQLOS because the more I understand about SQL Server’s internals the more I understand everything else I learn about SQL Server – I read Kalen Delaney’s Inside SQL Server 2000 cover-to-cover several years ago and it pushed my understanding of the field forward immensely.

I won’t regurgitate the content of Maciej’s course but he effectively covered a massive range of topics and introduced me to several new concepts as well as strengthening my knowledge of others, the rough outline was:

• SQL OS history, services and DMVs.
• Using Affinity Masks effectively.
• Non Uniform Memory Access (NUMA)
• Software NUMA.
• Configuring TCP-NUMA affinity.
• Virtual Address Space on 32 & 64-bit
• AWE and Large Pages
• Buffer Pool architecture and memory allocation.
• eXtended Events

Over then next few weeks I may blog some more detail of what was covered in the course but I’ll only do so if I find the time to put into some of my own research and write my own examples – it’s OK to stand on the shoulders of giants but it’s not OK to copy work from over their shoulder!

Maciej was a great speaker, extremely enthusiastic and well-deserves his reputation as the Dr. House of SQL – out of the many hours of training I’ve received in my career this was definitely one of the most beneficial and ‘action packed’ – all killer, no filler.  If you ever get the chance to check-out one of his courses in future I’d recommend it, his next public session will be in Germany (click here for more info).

Being an occasional rather than hard-core Unix/Linux user I was worried that much of the conference would be beyond my technical comfort-zone, this can sometimes be a good thing because it forces us to learn but as it turned out the Open Tech conference focused much more on the Open Systems part of the UKUUG’s mandate and concentrated particularly on Open Data in the government and media spaces. After reading the conference schedule and realising that it was all about data I thought it was definitely worth a look so I pre-registered (the only cost being a ridiculously cheap £5 on the door).

The attendees were quite mixed but dominated by developers working in the academic, government and media sectors (incl. journalists), giving the event a different atmosphere to most technical conferences I’ve been to which are usually either centred around commercial users or the security/hacking community. The result of this was that there were a lot of interesting people there who’ve really made use of the Open Data available, shared their work and in some cases made a real difference to government policy as a result. Before the sessions started I ended up talking to a few people including one of the guys behind the excellent TheyWorkForUs.com which despite the government’s Open Data initiatives still has to rely on good old fashioned web scraping.

I attended a couple of talks about the data.gov.uk projects which included some great examples of how the data can be used including talks by the people behind Where Does My Money Go and the ASBOrometer.  As a complete outsider to the Open Data world I’ve been extremely impressed with the amount of data that’s been published and the community that’s grown up around it, the best part being that the ‘community’ is made up of developers and civil servants working together to achieve something that I honestly think is quite ground breaking.

Stepping away slightly from the government-oriented data projects Manuel Corpas delivered an interesting talk entitled “Who Owns my Genome Data” essentially bringing up issues raised by companies such as 23 and me who will provide a personalised report for you based on your genome (all you provide is a saliva swab) but then retain the rights to use your data and future innovations derived from it.  Patrick Bell followed with an introduction to the British Geological Survey’s Open Geoscience site which seems pretty good on the face of it and they seem to be committed to open data but I found it difficult to think of applications for the data that would make sense to me personally.

The last batch of talks I attended related to mobile phones and mobile content, the first being the Wild Ducks Smartphone talk by Sebastian Brannstrom from the Symbian Foundation.  I hadn’t realised until the talk that Symbian still accounts for over 40% of the global Smart Phone OS market even though Android and iOS take centre stage in the public’s (or the media’s) eyes, with the OS now being Open Source they’ve launched a project to build a handset based on easily available components that you could hack together yourself, based around the Beagle Board with some extensions.  The talk was very interesting and it was great to see a demo unit that Sebastian passed around the audience, you can see more on the Wild Ducks blog.  The last talk I saw was by Terence Eden and was titled “Why Doesn’t Your Site Work On My Phone?”, essentially it provided a timely warning to developers not to run after the ‘hot potatoes’ of Android and iOS when much of the global mobile market (81%) still relies on ‘feature phones’ which by-and-large have basic HTML capability but not too much more, some handy resources he pointed towards were WURFL, Device Anywhere and Device Atlas.

All said and done I’d say the conference was definitely an eye-opener and if I can make the next one in 2011 then I’ll definitely go but I’ll feel like a failure if I turn up having done nothing with all the knowledge I gained from the 2010 presentations so I better hurry-up and get my hands dirty with some of this Open Data…

From July 16th – 18th 2010 in New York City the guys behind 2600 Magazine will be hosting The Next Hope, a conference for hackers of all types: amateurs, hobbyists, professionals and the generally curious.

Topics are wide and vary from IPv6 to Phone Phreaking, Disaster Relief to Graphic Novels and Cooking to DNS Sec – here’s the full talk schedule announced Monday (see table with abstracts here)…

Friday 16th

Saturday 17th

Sunday 18th

Simon Sabin kicked off the talks with a session on SQL Server 2008 Development Features, I’ve not had a good chance to try them out myself since I’m not on 2008 yet but the real highlight is the addition of the DATE and TIME data types – see my other post DATE and TIME Data Types in SQL Server 2008.

Management Studio now includes Intellisense which as been available in Visual Studio for a long time, it will automatically offer suggested keywords as well as table/object names whilst you type and can dramatically speed up your SQL writing.  Also new in SSMS is the ability to debug your code and step through it line by line, the debugger will even step into and out of stored procedures and user-defined-functions – this will be a life saver for anyone working with a complex web of SPs.

Following Simon’s talk I headed into the intriguingly names T-SQL Tuning with Colin Chapman, Enzo Ferrari, and The Stig by Brent Ozar – with a title like that how could I not go?  The talk turned out to be a great one and Brent’s a very entertaining speaker but all the time you get the feeling that he really knows what it feels like to be a DBA with production issues.  Most of my notes from Brent’s talk don’t type-up well but he’s got some excellent resources on his site at http://brentozar.com/go/faster so please do check those out, my personal ‘take homes’ from his talk were to mine the DMVs for performance data, to use mirroring as a way to manage uptime during OS/SQL patch cycles, use a text-file to build a change log on servers and to read the Microsoft whitepaper on index defragmentation.

The Keynote was given by Donald Farmer and showed took us on a journey through the challenges of BI from the perspective of a businessman from the 1920s who shared many of the same problems that we do in business today, it was quite an interesting angle and an amusing talk all-round.  The address culminated in a demonstration of PowerPivot, a new BI technology centred around fetching large sets of data into a cube sitting behind Excel then allowing the users to perform Excel-like calculations as well as joining the data to other tables/spreadsheets.  I believe that the tool is aimed at analyst-level users but the whole idea of putting large data sets in the hands of users (in the demo it was a million rows) and expecting them to manipulate it seems a little like a backwards step – isn’t the heavy lifting meant to be done on the server?  Don’t get me wrong, if the demo was anything to go by I’m not too worried about performance – more concerned that many users just aren’t equipped to (and don’t want to) perform this level of analysis.  I’ll watch with interest but colour me sceptical.

On both the Friday and Saturday I attended the Sponsor talks by Solid Quality Mentors, both given by Mark Whitehorn and both excellent.  From past experience the sponsor talks vary between product demos and general advice but Mark’s talks took a “let’s think about something different” approach.  Friday’s talk was about Social Data and considered what sort of social data large companies such as eBay and Facebook collect, how they can get the most out of it and in some cases why it can be considered more valuable than transactional data.  We also had a bit of a discussion around the moral implications of collecting social data and whether or not it was legal or ethical in certain circumstances to use the data for marketing purposes or perhaps sell it on.

In addition to working with Solid Quality Mentors Mark is also a lecturer at the University of Dundee where there will soon be an MSc in Business Intelligence, and Saturday’s talk was based around some academic research he had been involved in (published in Nature).  The research had involved manually collecting data from around 5,000 plant specimens originally sourced by John Stevens Henslow, a friend and lecturer of Darwin at Cambridge.  The study used modern BI techniques including data mining and even a Bing Maps mashup to demonstrate that Henslow had been studying variation before Darwin had arrived at his theory and was quite likely to have been a strong influence on Darwin’s own thoughts on the subject that made him one of the world’s most famous scientists.