How to Set a AD Computer Group Policy for Remote Desktop Logoff Delay Period?

The Microsoft AD docu defines GPOs as follows

Settings for user and computer objects in Azure Active Directory Domain Services (Azure AD DS) are often managed using Group Policy Objects (GPOs). Azure AD DS includes built-in GPOs for the AADDC Users and AADDC Computers containers.

It looks like you are after a special configuration of a GPO for a computer, and more specifically the Session Time Limit, see https://www.sevenforums.com/tutorials/118889-remote-desktop-set-time-limit-idle-sessions.html

Further reading

• Serverfault: Remote desktop sessions - Unwanted automatic log off after period of time
• https://docs.microsoft.com/en-us/windows/security/threat-protection/security-policy-settings/interactive-logon-machine-inactivity-limit

You would be using the Group Policy Management tool to set an AD GPO. Make sure you load the Admin templates (.admx) for the Windows versions you use so you can access newer options in the GUI.