Gallio – Visual Studio Integration – Issue with output of data-driven tests

I recently came across the Gallio platform, a “common object model, runtime services and tools (such as test runners) that may be leveraged by any number of test frameworks”. Essentially Gallio acts as a one stop shop for test integration and the “killer feature” for me is it’s integration into the Visual Studio test view. For those of us that do not have access to Resharper or Testdriven.NET (and have no way of running anything but MSTest tests directly through Visual Studio), Gallio’s offering is very appealing. It allows the user to run any test type supported by the Gallio platform (MbUnit, NUnit, xUnit, etc.) through Visual Studio as if they were MSTest unit tests – brilliant.

For instance, the following screenshot shows a few simple MbUnit tests in Visual Studio, as well as the test run results in the Test Results window…

image

An unfortunate limitation of the mismatch between MSTest’s restricted feature set and MbUnit’s far more expressive set is that some more advanced features are lost in translation. 

  1: <Test()> _
  2: <MultipleAsserts()> _
  3: <Row(3, 3)> _
  4: <Row(3, 17)> _
  5: <Row(1, 2)> _
  6: Public Sub MyRowTest(ByVal val1 As Int32, ByVal val2 As Int32)
  7: 
  8:     Assert.AreEqual(Of Int32)(val1, val2)
  9: 
 10: End Sub


For instance, the above rowtest should run three times and fail twice. However it completes successfully with the following message:




MyRowTest(3,3) Duration: 0.016s,



Assertions: 2




Luckily for me, I posted the issue (ineloquently) on Stackoverflow, and Jeff Brown (MbUnit and Gallio lead) not only answered but logged the issue as an enhancement for an upcoming milestone. Perfecting this integration would make Gallio a must for us developers with a limited tooling budget who want to integrate non MSUnit tests into our .NET projects and do not fancy ALT-tabbing all over the place.

Comments

Anonymous said…
Thanks for sharing the link, but unfortunately it seems to be down... Does anybody have a mirror or another source? Please reply to my post if you do!

I would appreciate if a staff member here at irwinj.blogspot.com could post it.

Thanks,
Oliver
September 28, 2010 at 4:47 AM
Jason said…
Hi Oliver,
Which link are you looking for? All of the links seem to work fine from this side.
Thanks
Jason
September 30, 2010 at 1:42 PM
Anonymous said…
Hi - I am definitely delighted to find this. Good job!
April 14, 2011 at 4:09 AM
Post a Comment

Popular posts from this blog

Excel - Adding an existing Pivot table to the data model

Image
  I've been working more with, and continue to be amazed by, Power Pivot. I recently ran into an issue where I needed to add the data for an existing Power Pivot report to the Data Model. There is a checkbox that makes this easy when creating a PivotTable: As so often happens, the analysis grew in scope/importance and I found myself needing to add the data to the data model. While it's not obvious how, there is a way to add an existing Pivot table to the data model. There's a More Tables... link in the PivotTable Fields pane.  Clicking on the  More Tables... results in a dialog confirming that you want to Create a New PivotTable .  Doing so will result in the creation of the new PivotTable in a new sheet. By default the data is added to the data model. You'll likely lose some formatting but for anything other than a trivial PivotTable, this should save effort, as it did for me.
Read more

Mirth

Image
Introduction Let's talk about Mirth. At it's simplest, Mirth  link is an Open Source HL7 interface engine. HL7 (Health Level 7) is an NPO involved in the development of healthcare standards and the HL7 v2.x and HL7 v3 standards are commonly used in Medical Information for data interchange - including but not limited to clinical, financial, logistical and administrative messaging. I first ran across Mirth over a year ago on a personal quest to find an alternative to our client's legacy HL7 application. Academically, I wrote a number of lexical analysis tools using lexx, yacc, bison and JavaCC and knew the challenges of writing and maintaining complex parsers. I was simply looking for something that could parse HL7 for us, and perhaps log messages and provide a little more transparency than our application currently allowed.  A year later and our legacy application is still going strong (read: my proposal was declined), but Mirth is being used in production, far away from th
Read more

Getting Started with Mirth (Part 1)

Image
This is the first post in a 2 part series. The second post is here Recently I posted about my positive experience when using Mirth by Webreach as an open source communication layer between one of our in-house applications and a third party and proprietary web service interface. That post received a large amount of attention (relative to my other posts :o) ) so now I will post a quickstart guide to creating a similar setup. In this post I will go over the very basics of using Mirth (please dig in and play around with some more advanced options/configurations), specifically I will demonstrate how to use Mirth to read data from a database, package the data up in a SOAP envelope, send the data to a web service and process the SOAP response. I'll also show you how easy it is to monitor channels once deployed. Once you've installed and opened Mirth for the first time you'll be presented with an empty dashboard - but it wont stay empty for long. This is where you'll s
Read more