Scanning Music With your iPad – OCR on Music Notation! (For FREE! – almost)

notatemelogo

All I can say is “Wow!”

Let me say that one more time, “WOW!!!”

Neuratron has really done it this time! First thing they did was to bring a handwriting app to market that we never hardly believed could happen! In fact, they did THAT in total “Apple style” – I don’t think ANYONE even mentioned it before that app just “showed up”! That app is called NotateMe Now (for the free but limited to one line of music version) or if you want the full version then the app is called NotateMe ($39.99 and worth every penny of it too!)

I will say that there WAS one company that had put together a very slick looking video with the concept of having an app that would actually allow us to handwrite music on our iPads. That video was THE hot topic for awhile – let’s see now… what was the name of that company again? Ah, never mind – it never came to be from them.

Now, Neuratron has done it all again! They released a plugin to NotateMe Icon SmallNotateMe that allows you to take a picture of printed sheet music and it will then take that picture, perform magic spells on it and then turns it into a computer notated file! (OK…. it’s not really magic spells but it seems like it!) That plugin is called PhotoScore.

THE BASIC CONCEPT:
Let me give you a visual…. (Clicking on any of the pictures in this blog post will give you another larger version that is easier to see.)

You take Sheet Music

NotateMe1

 

Take a Picture of it (I only used the free, one stave, version app – NotateMe Now. I have NOT tried the paid $29.99 In-App-Purchase – which I assume will work even better PLUS will do music with more than one stave in it!)

NotateMe2

 

and you end up with this…

 

NotatMe3

STEP ONE:
Now, to be fair there were just a couple of steps in between taking a picture and ending up with the Sibelius file but NOT MANY! What you will find that actually happens immediately after taking the picture in NotateMe is the app will scan the page and recognize the staves then recognize then notes. You get to watch as it does all that – it’s FAST! Then you will have this on your iPad…

NotateMe4

 

Now, I made that a bigger picture so that you could really see how accurate this app is! Above you see what NotateMe scans the picture you took as and to compare, below you can see a jpg of the actual sheet music…

 

NotateMe5

As you can see there were not MANY missed notes in the recognition! AMAZING! LOVE IT, LOVE IT, LOVE IT! This scan has the most amount of errors that I have gotten so far. I’ve done quite a few and usually there is only one or two missed items. In this scan you can see that there are some dotted 8th-16th note rhythms that the scanning process missed along with a couple of ties.

STEP TWO – EDITING THE SCAN:
Here is a link to a video which shows you how awesome NotateMe Now is at this whole process!  In the video you can see how crazy easy it is to edit the errors in the piece from above – it took me just 3 minutes. Most of that was simply looking back and forth to make sure the app didn’t miss anything.

Below I take you through a few  steps working with the NotateMe Now app, Notion for iPad and Sibelius on a laptop to get to a final product.
In the process of scanning some music with a lot of articulations in it I found that the app is not perfect on picking up all the articulations – it does pick up some of them but the Tenuto markings especially it has issues with. The D.S. and Coda text it did not pick up but it DID read the Gradually Softer marking. NotateMe does not read multi-rests either. So I had a few things to clean up but not much at all (In fact, I have used the laptop version of their app, PhotoScore, for years and I can say that this iPad version is BETTER!)

STEP 3 :ADDING WHAT WAS MISSED
So here are the steps I took to clean things up…. I COULD HAVE emailed myself an XML right from NotateMe Now and imported it into Sibelius on my laptop BUT this is about exploring the capabilities of what my iPad can do. So, I choose to use Notion for the iPad. Let me show you what I did….

Re-named the Part (This seemed to help later with transposing instruments especially!

NotateMe6

Exported the XML

NotateMe7

Opened it in Notion

NotateMe8

Found the correct file (I did not think this worked the first time. I expected Notion to actually pop open the file and it does NOT do that. It puts the file in the list and you have to open it yourself.

NotateMe9

Added extra measures because of the multi-rests

NotateMe10

Inserted the actual rests

NotateMe11

 

I then edited all the articulations in Notion – I feel like it is faster on the iPad then in Sibelius (and I’ve been working with Sibelius a really long time – I even have shortcut set up to speed up the process. I just feel like it is way easier to tap the note, tap the articulation – done.) Don’t forget –  when there are multiple notes in a row that need the same marking you get them all at once!

NotateMe12

Moved the dynamics and edited them (I’m not sure if NotateMe or Notion was putting the dynamics ABOVE the music but it was getting messed up!) There was one spot I could not squeeze in a crescendo either…

NotateMe13

 

STEP 4: EXPORT TO SIBELIUS FOR FINAL STEPS
Then I finally sent the XML file over to the laptop to import into Sibelius (I really just did not feel like trying to figure out how to put all the single parts – flute, clarinet, sax, trumpet etc…. into one big score using Notion – That’s another day!)

NotateMe14

Once in Sibelius I only had a couple of things to do – I had to work out the transposition. This was tricky…. I’m still not sure if this is me or the apps. Sometimes things worked out fine – other times I had to use the up and down keys to get the notes in the right spot. I’ll explore this issue more and write another post about it.

HINT – The one thing I DID figure out is that I needed to have the correct name for the instrument right from the get go – that’s why I renamed the part in NotateME!

So what did I have to do in Sibelius? I moved the dynamics into the correct spot BELOW the music and  I reset my beam groups – you can see in the pics below that for some reason those 8th notes got really messed up some place in all the transferring between NotateMe, Notion, XML, and then Sibelius. A couple of clicks though and it was done.

NotateMe16

Resetting the Beam Groups in Sibelius

NotateMe17

Moving the Dynamics to below the staf

NotateMe18

Added the crescendo between the FP and FF that Notion would not allow me to.

STEP 5:FINAL PRODUCT:
I’m not done with all the parts yet – I was to excited about how well this worked! I had to share with all of you!
NotateMe Final

 

WHY:
Why even bother with this process? Imagine being able to give a student an assignment to learn a piece of music. Now, with this technology, if they have questions about how the music is to sound they can scan it and end up being able to hear the rhythms and pitch!

How about if a student wanted to write out a duet part? Well now that process is going to be much faster – they scan the first part, add a second part, copy the easy sections where maybe they just need to raise or lower the part a 3rd, add in the other sections where it takes a bit more rewriting and then print! Plus they can listen to it as well!

What if your band has no tuba players? Take the tuba part, scan it, change it to marimba and give your percussion something else to do besides hit each other with their sticks!

The list could go on and on!

IN CONCLUSION:
The only reason that I actually even used Sibelius at all is because I am still using the free version of NotateMe Now which only scans single stave music. I am currently working on all my marching band music and trying to get it digitized. Of course one reason I am doing that is so that the students can do SmartMusic  testing on our marching show music when we get back to school in the fall. So for every instrument I repeated the above process. Eventually I will end up with all the parts in one Sibelius file, all without hardly ever having to input anything by hand or playing it in with my keyboard.

Let me assure you – this does NOT take as long as it may seem. It takes a few times to get the hang of the process but after doing 3-4 you will be much faster at it all. In the time it took you to read this blog post I probably worked through two more parts.

For this entire Blog Post whenever I referred to NotateMe and PhotoScore, I used the free version of NotateMe Now which gives you the ability to work with a single staff for FREE! So you get the ability to handwrite music on a single staff for free AND the PhotoScore capabilities for single staff music for FREE too! Good enough for music students to make great use of in class and in lessons.

The full version of NotateMe Icon SmallNotateMe is $39.99 – Yup, I know, someone just choked on their gum. For an iPad app it seems expensive. For what it does it is not! The In-App-Purchase to get the PhotoScore Plugin is another $29.99 – Let me put this in comparison for you though – The actual computer app that does the SAME thing is $249! Plus, I’m telling you, the iPad version is BETTER!

Don’t believe me about how awesome this all is? Go get the free version – NotateMe Icon SmallNotateMe Now

Also, please make sure that you read about which devices are supported, especially for the PhotoScore app. This technology astounds me that it is even possible on a mobile device! It should not astound anyone that PhotoScore requires a camera that is of higher quality which means the iPodTouch 4th gen, iPad2 and iPadMini 1st gen are left of of the loop for PhotoScore. I mean, come on people, this is replacing a scanner for goodness sakes!

Using Notion Small IconNotion’s iPad app ($15.99) to edit the files was a joy! This app is not for those of you with only a 16GB iPad though – Notion by itself takes like 2GB! That’s because of the awesome sampled musicians from the London Symphony Orchestra that is crammed inside of you iPad when you purchase Notion.

HINT – If you are a saxophone person you will have to spring for the $1.99 in-app-purchase to get that Alto Sax sound! Same for the Tenor and same for the Bari Sax. You will get a great basic set of sounds with your original purchase of Notion but for some STUPID REASON they don’t include saxophones in that set! I HOPE NOTION IS READING THIS AND CHANGES THAT DECISION! Or should I just talk to PreSonus?

SymphonyProV3SymphonyPro – ($9.99) would work just as well and doesn’t take up as much space on your iPad. Of course the London Symphony doesn’t come with SymphonyPro either

 

HELP SUPPORT THIS BLOG PLEASE! All the links from my blog posts are affiliate links. What that means is that if you decide to purchase one of these apps by clicking on the links I’ve provided then I get a small percentage of the sale. The developer’s get their portion still but I get a small (very small) portion of Apple’s profit. If you appreciate the tips and ideas I share with you and you decide to purchase the apps mentioned anywhere on my blog it helps me to keep going. Thanks for considering the possibility of clicking my link first then purchasing the app from the store.

 

 

 

 

About these ads

11 Responses to “Scanning Music With your iPad – OCR on Music Notation! (For FREE! – almost)”

  1. David Says:

    Great article! I’m very excited for the PhotoScore possibilities! And I jumped on NotateMe when it was in beta for like $16, so I’m happy with the development. One question, and I know you were exploring the iPad capabilities. But, you ended up going to Sibelius anyway on the desktop. So, I’m thinking a simplified workflow would be to scan the score (in the full version of NotateMe), import to Sibelius to clean it as a score, and export parts. Isn’t that easier?

  2. Steve Says:

    How do you go from Sibelius to smartmusic I thought you had to use finale?

    • Paul Shimmons Says:

      You are correct about having to go from Finale to get music into SmartMusic. I have both Sibelius and Finale just because of that functionality. I really like the workflow in Sibelius so much better and I can get my music into Sibelius about 3 times faster than what it takes me in Finale. That’s not because I have not used Finale either – I started using Finale first, back in the days when you kept 3 manuals next to your computer just so you could figure it all out!

      So yes, the workflow I normally use is – Input music into Sibelius, Export as XML into Finale, THEN Export as a SmartMusic file

  3. Linda Says:

    Hi Paul,
    Thank you for this wealth of knowledge. I will definitely support your blog and click on the links for purchase. I am confused about this sentence: The In-App-Purchase to get the PhotoScore Plugin is another $29.99. I am not quite sure what that means. Can you please explain? Sorry, I tried to figure it out, reread your article a couple of times. I appreciate the clarification. I already use Finale and do lots of composing. My students use the iPad as part of enrichment required each week so I am using lots of different things but want to add this in to my program. Thank you for your help. This is awesome!!!

    • Paul Shimmons Says:

      Thanks for reading about all my adventures and explorations! That is the best way to learn all this stuff you know – explore and play!

      OK – the price for “NotateMe Now” is FREE and that price includes PhotoScore BUT you are limited to one line of music/one staff. So you would be good if you are writing out just a melody or just a trumpet part for instance.

      The price for “NotateMe” is $39.99 BUT if you want to do the scanning part then there is an In-App-Purchase for PhotoScore that will cost another $29.99. This gives you a full version of both functions – the handwriting PLUS the scanning.

      NotateMe and PhotoScore are really like two apps inside of one. You start with NotateMe and then add on more functionality with PhotoScore.

      Does that help? If you are still confused let me know and I can do a quick video that may help.

  4. Cláudio Mendes Says:

    Eu quero !

  5. Neil Sands Says:

    We’ve been using NotateMe at the Chichester Music Press since it was in beta, and Photoscore within it for the last several weeks. It’s working very nicely for us. It’s astonishing that an app can even begin to do things like this, let alone do them well. Hats off to Neuratron.

  6. Paul Shimmons Says:

    I agree with you Neil! Astounding that last year at this time we had to use a full fledged scanner and a regular computer to achieve this same outcome! Now, it’s $70 worth of an app with an iPad WHEREEVER we want! Glad to know it is working well for you guys too!

    Glad to have you discover my blog – hope you can find ideas here to help you out in your journey of using tech to create and manipulate music!

  7. Armando Morales Says:

    Hi,
    I’m a middle school choir teacher and I wonder how photoscore would work with scanning a choral piece? If it was for a 2 part piece, for example, you’d have a total of four staves. Top two lines for voicing, bottom two being the accompaniment. Would this app be functional for that?

    • Paul Shimmons Says:

      You know what? Chris, over at techinmusiced.wordpress.com is a choir teacher and he is using this software too so I’m pretty sure he could directly answer that question


Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Follow

Get every new post delivered to your Inbox.

Join 763 other followers

%d bloggers like this: