AMD/Nvidia switchable graphics not working

On a system with AMD Ryzen 5 and Nvidia GTX 1650 switchable graphics are not working.

Just to get the drivers working for the respective chipsets, I had to upgrade to kernel 5.6 for amd and install nvidia 450 drivers for nvidia. This gets us to the point where both cards are operational. However, I have to manually in xorg scripts essentially use my nvidia card as primary because otherwise it just wont be used.

ProblemType: Bug
DistroRelease: Ubuntu 20.04
Package: linux-image-5.4.0-45-generic 5.4.0-45.49
ProcVersionSignature: Ubuntu 5.4.0-45.49-generic 5.4.55
Uname: Linux 5.4.0-45-generic x86_64
ApportVersion: 2.20.11-0ubuntu27.6
Architecture: amd64
AudioDevicesInUse:
 USER PID ACCESS COMMAND
 /dev/snd/controlC0: cary 1768 F.... pulseaudio
 /dev/snd/controlC1: cary 1768 F.... pulseaudio
CasperMD5CheckResult: skip
CurrentDesktop: ubuntu:GNOME
Date: Sat Sep 5 15:11:01 2020
InstallationDate: Installed on 2020-09-05 (0 days ago)
InstallationMedia: Ubuntu 20.04.1 LTS "Focal Fossa" - Release amd64 (20200731)
MachineType: Acer Nitro AN515-44
ProcEnviron:
 TERM=xterm-256color
 PATH=(custom, no user)
 XDG_RUNTIME_DIR=<set>
 LANG=en_US.UTF-8
 SHELL=/bin/bash
ProcFB: 0 EFI VGA
ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-5.4.0-45-generic root=UUID=979e8784-acdb-4946-84ac-24051691c304 ro quiet splash vt.handoff=7
RelatedPackageVersions:
 linux-restricted-modules-5.4.0-45-generic N/A
 linux-backports-modules-5.4.0-45-generic N/A
 linux-firmware 1.187.3
SourcePackage: linux
UpgradeStatus: No upgrade log present (probably fresh install)
dmi.bios.date: 04/16/2020
dmi.bios.vendor: Insyde Corp.
dmi.bios.version: V1.01
dmi.board.asset.tag: Type2 - Board Asset Tag
dmi.board.name: Stonic_RNS
dmi.board.vendor: RO
dmi.board.version: V1.01
dmi.chassis.type: 10
dmi.chassis.vendor: Acer
dmi.chassis.version: V1.01
dmi.modalias: dmi:bvnInsydeCorp.:bvrV1.01:bd04/16/2020:svnAcer:pnNitroAN515-44:pvrV1.01:rvnRO:rnStonic_RNS:rvrV1.01:cvnAcer:ct10:cvrV1.01:
dmi.product.family: Nitro 5
dmi.product.name: Nitro AN515-44
dmi.product.sku: 0000000000000000
dmi.product.version: V1.01
dmi.sys.vendor: Acer