I always thought Sony’s QX10 was a smart idea. The lens contains an image sensor and links to the phone via bluetooth and is controlled from there.

This could be taken one further by having an E-mount sensor that can be magnetically attached to a phone and is compatible with that full range of lenses. All the controls would still happen on the phone display.