KB5034123 has been replaced by KB5034204 that's the one I can't install. It has crypto changes in it so it probably requires TPM.TPM has no issue with Windows Updates (my computer is also non-TPM compatible)
Try download and install manually https://www.catalog.update.microsoft.com/Search.aspx?q=KB5034123