Smooth "stepless" terrain/mesh editing (ingame)

Yes, see @pspeed post about isosurface and marchincubes there is also the full source code attached. Someone took it and made a game you can find on steam, iirc the name is Rising World.
This could be what you are looking for.