Doesn't matter how good the hardware is if the software can't make it useful for users, which is largely the problem here.
Most of those 'high MP' cameras are also not really useful anymore without an ISP and those aren't available open-source (except perhaps with camera emulation and a fake CSI interface to the application processor cores).
The RK3399 does have a rather limited ISP, not something you'd want to pump 88M in. If you were to use only 1 camera and combine the two ISP nodes it has you'd have a maximum of 26M. This is also why they used a IMX258 as anything better would require to use the second interface for that single camera too.
But to clarify: it's not really as much about "any ISP" as it is about a good ISP that can do multi-camera composition. The ISP in the RockChip SoC can't even do one, it mostly just does basic cropping/rotation/resizing and controls the PHY. While technically an ISP, it's more like an interface driver at this stage. The driver is open source, but the hardware isn't. That's not always a bad thing, as in this case the hardware doesn't run on any RT blob, it's mostly just a bunch of registers for (image) stream processing.
I think in the android rom hacking world, most ISPs are used with their binary blobs (both firmware and kernel modules) but without the configuration and user land blobs, resulting in working cameras (at high pixel counts) but really bad image quality.
RK3399 ISP does much more than cropping/resizing. (It can't do rotation, btw - if it can, I wanna know where you're getting your details from, because that would be very useful :))
IIRC the other operations are only supported on the other linux media framework (of which I can't remember the name - but it's the newer one than v4l2), and most examples I saw (a while back with a RK3399 dev board) were using libcamera at the time.
It does indeed not need firmware, but higher end IPS blocks often do, especially when you get much higher bandwidth sensors per CSI channel.
What I am wondering now about those calibration tools is if however they are built or reverse-engineered, they could read the pre-existing calibration payload.
Whole of ISP uses v4l2. You communicate with ISP by sending specially formatted buffers (C structs docs I posted) via v4l2 buffers (the same interface you'd get image data, too).
Preexisting calibration data are just XML files with params to load to the ISP and params to use to determine which set of params to load based on statistics collected from ISP (like after detecting what kind of light the scene has, you have to load params calibrated for that light type).
(I do rotation via RGA, so maybe you mean that? That's a separate HW block, not part of ISP.)
> Sure sounds like iphone will get there first, pine could beat them to it.
Pine64 doesn't make any of those components. High end components are also generally from manufacturers that don't share documentation, so entirely useless for Pine64's goals.
PinePhone couldn't even create a phone that can make voice calls properly like a Nokia 3310, yet you're envisioning them beating Apple (!) with rolling out some futuristic technologies.
>PinePhone couldn't even create a phone that can make voice calls properly like a Nokia 3310, yet you're envisioning them beating Apple (!) with rolling out some futuristic technologies.
I believe I understand why you feel I am unhinged.
I said, "Sure sounds like iphone will get there first, pine could beat them to it."
Obviously I said iphone will win, I optimistically or enthusiastically said pine could put in the work and get there first.
>having unrealistic expectations may be considered unhinged by some.
I feel like I wasn't being unrealistic at all.
solid state batteries exist today and can be bought. Obviously early in the commercialization but they do exist. Still unclear how safe they are.
88mp camera is less than what I can go buy from costco right now.
3d scanners totally fit in your pocket. I don't mean photogrammetry neither. The newer iphones have lidar that can scan. Newer androids have depth sensors or TOF sensors.
13MP camera is nice. Specs are certainly much improved. Probably enough for daily driver.
My next phone though:
Next battery tech, solid state?
88mp front cam as this is the threshold for beating film.
depth cam that can 3d scan things for me.
Sure sounds like iphone will get there first, pine could beat them to it.