In 1780, when Scurry was 14 years old, he set on a voyage from Plymouth Sound on the Hannibal. However, he, along with his crew, were captured by the French at Saint Helena. They were handed over to Hyder Ali by the French admiral Suffren. Hyder deported Scurry and the 15 young men to Seringapatam. The 15 men were all circumcised, converted to Islam and forcibly conscripted to Tipu's army. James Scurry was given the Islamic name, Shamsher Khan. As soon as Scurry was captured, he was put in heavy leg-irons and marched into a strong prison.[6] Later, Hyder ordered him and his crew to march to Bangalore.[7] Scurry was then sent to Burrampour, a three-day march from Bangalore. The food offered was rice for the first eight to ten days, which was then changed to Ragi flour. Scurry had the misfortune of being overlooked, along with 100 other English prisoners in the prisoner release incorporated in the treaty of 1784. Scurry on his own account explains how he escaped from the fort of Chitterdroog (Chitradurga). Once he tried to escape with some more of his colleagues, but after some distance, returns on fears of being spotted. Again, he escapes in the next try, but this time, they venture into the forest to avoid being detected. They camp in multiple places, and try entering a couple of forts. They finally seek the help of Marathas in a fort, from where they leave for the English encampments in a fort north of Karnataka.He was greeted by an old Scottish colleague, Mr. Little, who was startled to find Scurry and his companions in the ragged uniform of Tippu's army.[5] James further narrates how they are redeployed, and marched backwards to the Carnatic to help plan the final assault on Mysore by Lord Cornwallis. Due to some circumstances, his friends are divided into two groups, and one group is sent to Bombay, and he is sent to Madras. In Madras, he boards Dutton, a ship to send him back to England, and he reaches Down in England. He also tells that even though his release was negotiated between Tipu and the British, it was not implemented for reasons unknown. Instead he was abruptly shifted along with many other prisoners to Chitterdroog. During this shift, James fears for his life, as he was taken to a place where some of his colleagues Captain Rumney, and Lieutenants Fraser and Sampson, had their throats cut. Scurry left behind his wife and child, a girl. He had grown to love her, and in his memoir describes the immense pain he felt in having to part from them in the night as his battalion was being mustered and his decision of escaping being made. After the 10-year captivity ended, James Scurry recounted that he had forgotten how to sit in a chair and use a knife and fork. His English was broken and stilted, having lost all his vernacular idiom. His skin had darkened to the 'swarthy complexion of negroes', and moreover, he had developed an aversion to wearing European clothes. Scurry later reverted to Christianity, upon his return to England.