Notes SharePoint Blog

Steve Walch's blog about his favorite migration tool and other things related to Lotus Notes migration projects

Category Archives: InfoPath

Webcast recording on Migrating Notes Applications to SharePoint with Fewer Development Resources

Last week I recorded a webcast with SharePoint Technical Strategist Ira Fuchs from Microsoft.  We talked about fully leveraging the awesome “declarative development” capabilities in SharePoint and InfoPath for rebuilding complex Notes applications.  

75% of the presentation was about the concepts in Ira’s book for “Creating Enterprise Class Applications in SharePoint without Code”.  The rest was me trying to add the Notes migration perspective.  I thought the combination was very good and we had some good Q&A.

The webcast recording is here: http://www.quest.com/webcast-ondemand/-migrating-notes-applications-to-sharepoint-with-fewer-development-res816018.aspx

PS:  If you want to get a copy of Ira’s book for yourself, go to www.ihfpublishing.com and use coupon code “QUESTDISC” for a 30% discount.

image

Migration basics: Migrating to Document Libraries

From the perspective of a migration specialist, a library is very similar to a list. The main difference is that in a library, each “document” is an actual binary file with various data properties associated with it.

Therefore, migrating a Notes database to a SharePoint document library could be as simple as extracting binary file attachments out of each Notes document and placing them in the library.  This simplistic approach makes sense if the Notes application itself was designed to manage binary files—that is, if each Notes document is really just a wrapper around a binary file attachment.  Domino.Doc is an example of this type of application.  In the screen shot below Notes Migrator for SharePoint was used to extracted the attachments from each Notes document and placed them in a document library.  You can also extract various metadata items about each document and map them to SharePoint properties.

image

Be aware that several things can go wrong with this type of migration job. If there are no attachments in a particular Notes document (i.e., if it is just a normal rich text document), then nothing will be migrated to the library.  If there are multiple attachments in a particular Notes document, they may all be migrated to the library but they will no longer be one self-contained document.  In either case, you have probably misinterpreted the way the Notes application was used, and it should not have been migrated to a library in this manner. 

There are two answers to this dilemma.  The first possibility is to migrate the application to a list instead if a document library.  Even if it was called a “document library” in Notes, it may be more appropriate to map it to a custom list in SharePoint.

The second possibility is generate new documents (one for every Notes document) and check those into the document library.  Notes Migrator for SharePoint can convert Notes documents to a variety of file formats, including HTML, MIME, Word, PDF, and InfoPath.  These are the binary files that you check into user will open when they click on “the document”.   The three most popular choices for formatting Notes documents as binary files are discussed below.

Microsoft Word

Microsoft Word is a popular choice in environments that have standardized on Microsoft Office for document creation. The integration between Microsoft Office and SharePoint libraries is very good and can enable you to build a variety of powerful applications. Users can open documents from libraries, edit them and seamlessly save them back again. If a version control, check-in/check-out, or approval process or workflow has been enabled for the library, it will all work automatically. Office clients even support single sign-on with SharePoint and SharePoint Online Dedicated.

Office documents in SharePoint libraries are easy to search and you can even generate an instant SharePoint workspace to enable teams to collaborate on a particular document. Multiple users can open the same Word document and edit it at the same time, and users can see the changes being made by other users almost instantly.

When migrating Notes documents to the Microsoft Word format, you can migrate to simple unadorned Word documents or to custom Word templates. You can also migrate Notes data items to Word document properties or even to content controls in your custom template.

The following screen shot shows a Notes rich text document that was converted to a Word document on a custom letterhead template and checked into a SharePoint document library:

image

For more details on migrating to Word documents, see these posts.

PDF

PDF is another popular choice for migrating rich text Notes documents. Many organizations, especially in Europe, use PDFs to archive old content. Since PDF is now an open standard, the assumption is that there will always be a PDF reader such as Adobe Acrobat available in the future. An organization that has a large number of Notes databases with rich text documents may find that PDF is an ideal target format for many of them.

When PDF documents are placed in a SharePoint library, the integration is not quite as tight as it is with Office applications, but the user experience is still reasonable. Even though PDF readers and editors are not generally “SharePoint aware,” the experience of opening PDF documents is similar to downloading them from any web site. PDF documents can work with SharePoint’s search features, but you need to install a free add-on from Adobe for SharePoint’s full-text search indexer to read the content.

A word of warning about migration tools: a number of tools advertise the ability to convert Notes documents to PDF documents, but deliver poor results. If you plan to use this feature, we strongly recommend that you test the tools with your user’s most complex documents. Watch for how nested tables, embedded images, links to attachments and doc links are handled.

The following figure shows a Notes rich text document that was converted to a PDF document and checked into a SharePoint document library:

image

PDF migrations are discussed in more detail here.

Document rendering

In some cases, simply converting the rich text bodies of your Notes documents to Word or PDF files is not good enough because it does not capture the rich form layout that Notes users are used to. Without the form layout, you really haven’t captured all the information.

This is where an advanced concept known as document rendering comes in. With this technique, the migration tool “renders” each document with its original Notes form to generate a new rich text document that includes the entire form layout you had in Notes. To visualize this, compare the generated PDF document in the following figure with the PDF example provided above:

image

In addition to the rich text body, we captured the information that was presented with the original Notes form. Most significantly, we did not have to redevelop the form in SharePoint to accomplish this, nor did we have to explicitly map all the data fields that are displayed in the form header.

We used PDF in this example, but the same concept of rendering documents with forms applies equally well to Word documents, InfoPath documents, pages and even lists.

The Render With Form feature is discussed more fully here.

InfoPath

People sometimes choose the InfoPath document format when they want to migrate complex Notes applications to SharePoint, usually for one of two reasons: either the applications have complex data structures that do not lend themselves to being stored in a SharePoint List, or the applications have complex form designs that contain dynamically hidden sections, input validation rules, buttons, form events, or other sophisticated form logic. Ways of addressing the second issue are discussed in the section “Migrating Application Designs” below, so for now, we will focus on the migration of Notes content to InfoPath documents.

InfoPath data documents (traditionally called “InfoPath forms”) are really XML files that you edit using the InfoPath client (part of Office) or perhaps in a browser if your SharePoint server is running InfoPath Form Services. You specify the layout and behavior of your InfoPath form (and associate it with your desired XML schema) by creating an InfoPath form template. Typically you would store your XML data documents in a special type of SharePoint library known as a form library. This library is associated with one or more form templates in such a way that end users get a fairly seamless experience of creating, viewing and editing complex documents right from the library.

When performing a Notes migration, your main job is to convert Notes documents to InfoPath XML data documents according to a particular XML schema and check them into a form library.  Notes Migrator for SharePoint makes this fairly straightforward.  All you need to do is load in an InfoPath form template and specify how you want various Notes data elements to map to the various parts of your new XML schema.  These elements might include not only simple data fields, but also rich text, embedded images and attachments, links to external attachments, and links to other documents.  As XML schemas are not necessarily one dimensional, you may need to map one-to-many data items as well (for example, a product description document might contain multiple distributor names).

The following screen shot shows a Notes rich text document that was converted to an InfoPath document (associated with a specific InfoPath form template) and checked into a SharePoint form library:

image

NOTE:  We did not specify how the InfoPath form template was created. It may have been created from scratch by your InfoPath developer or you may have migrated an existing Notes form using Notes Migrator for SharePoint.

For more details on InfoPath migrations, look here.

Details, details, details

Additional considerations for migrating to SharePoint libraries include:

  • Notes documents contain metadata such as Created By, Created Date, Last Modified By, and Last Modified Date. Many migration tools drop this metadata during migrations to SharePoint, resulting in a major loss of business data.
  • Most Notes databases contain access control lists, which determine what specific users can do in a particular application. In addition, individual documents contain access restrictions such as Readers lists and Authors lists. Access definitions may use groups in the Domino Directory as well as roles defined for the database. Preserving all this information correctly in SharePoint may be critical to a successful migration of sensitive data.
  • If your Notes application has a concept of document versioning, make sure your migration tool allows you to correctly map the versioning to SharePoint versioning. All versions of a given document in Notes should appear to be versions of the same document in SharePoint.
  • It is common to want to assign folders during a migration. You can dynamically generate folder names in SharePoint based on data extracted from Notes.
  • Instead of folders, you may want to use a powerful new SharePoint feature called Document Sets. This feature is discussed in more detail here
  • When generating documents in a document library, you may with to put images and attachments in a subfolder or even in a different library.  This technique is discussed here.
  • For complex applications with mixed content, may wish to assign Content Types to documents as you migrate them.
  • Choosing the Type of InfoPath Form to Use in an Application

    Attention all application migration personnel!  Please read this white paper by Microsoft SharePoint Technical Specialist Ira Fuchs:  InfoPath 2010 Enhanced Integration with SharePoint Server 2010 and Its Implications When Designing Forms for Applications

    This paper does an excellent job describing how the new InfoPath List Forms and how they relate to the “classic” XML Document-based InfoPath Forms.  The paper culminates in the section “Choosing the Type of InfoPath Form to Use in an Application“, which I borrowed for the title of this blog post. 

    I met Ira in person last spring at a Quest Software social event in Seattle.  Before joining Microsoft, he worked at one of my large enterprise customers (financial sector) and was involved in some of their Notes application migration projects.  Like me, Ira is a big advocate of leveraging all the great designer tools in SharePoint to avoid having to write custom code whenever possible.  Ira actually wrote an entire book on the subject which I am happy to also recommend here:  Enterprise Application Development in SharePoint 2010 – Creating an End-to-End Application without Code.

    clip_image002

    Getting Started with Migration to InfoPath List Forms

    One of the most important aspects of migrating a Notes application to SharePoint is form design.  InfoPath is, of course, Microsoft’s primary solution for building data entry forms for complex business documents.  Many Notes customers see InfoPath as the best choice for migrating Notes forms that contain user-friendly field layouts, non-trivial data validation rules, and interactive functionality such as hide-when formulas. 

    With SharePoint 2007, the decision to use InfoPath meant that you were forced to store your data as XML data documents, usually in SharePoint form libraries.  Notes Migrator for SharePoint 5.x helped you migrate your Notes form designs to InfoPath form templates and also made it possible to migrate your Notes documents to whatever XML data schema you came up with.  Unfortunately this was a rather heavyweight solution suitable only for complex apps that should justify the development effort.

    SharePoint 2010 introduces a great new way to use InfoPath: InfoPath List Forms. This feature allows you to use InfoPath forms as your editor for list items. Now you get the best of both worlds: a lightweight way to store documents with custom schema and a great way to design custom forms for entering and displaying them.  The experience for developers is now greatly simplified and even junior developers can design custom forms using an integrated set of tools.

    image

    The best part of all this is that you already know how to migrate data to this type of solution.  The data is still living in a list, and Notes Migrator for SharePoint has been migrating data to lists since 2005.  In fact you can take any list you have ever migrated to and (assuming you have upgraded to SharePoint 2010) you can press the above button and add an InfoPath List Form to it.

    The new part that Notes Migrator for SharePoint 6.0 is adding to the equation is the ability to migrate your Notes forms to InfoPath List Forms.  When generating InfoPath List Forms, you need to create your migration job and provision your new List with the correct schema first.  (This is different than migrating to InfoPath Form Libraries, where you would typically generate a form template first and then generate your library from that.)

    You can access the InfoPath form generation capability from the Designer Client using the new Designer menus or from the Migration Console using actions on a selected Database record.   

    image

    For the new functionality, select the List option.

    image

    The form migration wizard takes you through the remaining steps for migrating your form.  We will detail this in subsequent articles, but the wizard is actually self-explanatory if you read it slowly and follow the steps carefully. 

    At the end of the process, you get an InfoPath List Form that looks just like your old Notes form.  Here is an example of a customer’s document in Notes and the same document in SharePoint.

    image

    As with our older “form library” form migration feature, the tool does an excellent job with the user interface but does not attempt to migrate formulas and other form events, so be prepared to roll up your sleeves and rebuild that functionality using your new SharePoint development skills.  SharePoint 2010 makes this part easier than ever, so make sure you learn the new development capabilities well.

    Cool stuff in SharePoint 2010 that Notes customers will love: InfoPath everywhere

    One of the biggest barriers to moving large numbers of Notes applications to SharePoint is the cost of rebuilding the complex applications.  As covered previously this cost is often overstated and can be mitigated by a good understanding of how to leverage out-of-box SharePoint features and code reuse, but it is still a very real issue. 

    SharePoint 2010 contains many advances that will dramatically reduce the cost of application development and (even better) will allow tools such as Notes Migrator for SharePoint to do a lot more of the work for you.  We will cover things such as improvements in declarative workflow, dynamic scalable views, ASPX pages and offline capabilities in other posts.  But first I want to talk about InfoPath.

    InfoPath is, of course, Microsoft’s primary solution for building data entry forms for complex business documents.  Many Notes customers see InfoPath as the only real choice for rebuilding Notes forms that contained user-friendly field layouts, non-trivial data validation rules, interactive functionality such as hide-when formulas, etc.  (That isn’t completely true, but InfoPath was certainly where most people start looking.)  The Notes Migrator for SharePoint features for migrating Notes form designs to InfoPath templates and migrating Notes documents to InfoPath data documents have certainly been very popular.

    image

    Unfortunately, there were some significant practical barriers to using InfoPath 2007 for large scale application development.  Here are the top three problems that I observed and how SharePoint 2010 and InfoPath 2010 solves them. 

    1. SharePoint/InfoPath 2007 forced you to store your data as XML data documents, usually in SharePoint Document Libraries, and did not really work with SharePoint Lists (the natural target for most Notes application content).  With 2010 you can use InfoPath forms for both Lists and Libraries.  You can even start with an auto-generated InfoPath form (based on your list schema) and start customizing it from there. 

    image

    2. Unless you were willing to deploy the InfoPath 2007 client to all your user’s desktops, you had to live with the limitations of InfoPath Form Services (try telling your Notes users that they can’t have embedded images anymore).  With 2010, there have been a number of dramatic improvements in InfoPath Form Services and the web experience really is at near-parity with the “rich client” experience.

    3. The process of building, maintaining and publishing InfoPath 2007 forms was a cumbersome and sometimes fragile process that was pretty much outside of “normal” SharePoint customization and development activities.  With 2010, you now have a very integrated experience which will make designing your custom forms a much more mainstream activity that even beginning developers can perform.

     image

    There are plenty of other InfoPath improvements that will reduce the cost of rebuilding Notes applications: additional controls, more seamless workflow integration, and automatic offline support.  My prediction is that InfoPath forms will replace ASPX pages (whether built by SharePoint Designer or Visual Studio) as the tool of choice for many developers and certainly for people trying to rebuild lots of Notes applications.

    Follow

    Get every new post delivered to your Inbox.