Dear Deva,
In this case you can use a child custom post type to tie each image to its caption. Make a child of the main custom post type and create separate forms.
Will this solution be suitable for you?
Please let me know if you are satisfied with my answer and if I can help you with any other questions you might have.
Regards,
Caridad