Remove settings from Gutenberg core block

From the core/image block in Gutenberg, I am trying to remove both the 'image size' and 'image dimension' settings. Is this possible to do without copying the entire block and removing the parts I wish to omit? The only things that come close to what I want is A) removing an image style:

// Remove 'rounded' default style.
wp.domReady( () => {
  unregisterBlockStyle('core/image', 'rounded');
});

and B) removing a panel from the editor (not a block) with:

const { removeEditorPanel } = wp.data.dispatch('core/edit-post');
removeEditorPanel( 'discussion-panel' );

I could use CSS to hide the settings, but I wish to remove them entirely.