This is my model, using Adam optimiser and lr of 0.0001.
This is the Training and the Validation loss plot below:

The value of mse=0.049 and r2=70.3%. My problem is the more images i include into my training model, the worse it gets but mse and r2 increases so this is very counterintuitive. This is a regression model using Nvidia's Model. I input the images and need a steering angle output. Am i actually making things more difficuilt than it needs to be by increasing data and epochs? I am training with only 1600 Images for 30 epochs. Will appreciate any suggestion from the experts as im relatively new to NNs.Will provide more details if needed thanks :)
