Sure, let me know when and I’d be more than happy to show you around the peninsular; just not right now, it’s freezing at only 22?c!
I can do that, but it will take me some time to extract the code from a project (I have already written and am using that code) and wrap it up so that others can use it. Just right now; I am really busy with a bunch of things (one of them being 64-Bit migration of existing applications).
There’s a bunch of ways to extract frames from video, probably the easiest is via CGImage, which can then be drawn into a Xojo picture for pixel analysis (or drawn into a CGBitmapContext created from a memoryblock and use the memoryblock to read pixel values).
You don’t need to understand any of the movie formats, however the second method for extracting frames is really interesting as it can return a ARGB based memoryblock or YUV in a variety of different settings. Understandably the quickest to read is in the video’s native format (which takes some deciphering to figure out), as modern processors include optimized paths for reading video (hence why you can watch a movie for 10 hours on a 2016 Macbook Pro, but only use Xojo for 3~5).
AVFoundation and CoreImage go hand in hand, Core Image is optimized to process frames in YUV or ARGB, so for image manipulation on a frame, I would would recommend Core Image. However if you want to use Core Image to edit Photos, I no longer recommend it unless you’re doing some filter chains or using 12 megapixels from Apple’s Professional camera (iPhone).