Duo Unix: pam_duo

Hello
Is there a way to setup /etc/pam.d/sshd and /etc/ssh/sshd_config for publickey OR password? In other words, If a user prefers password first factor versus publickey first factor. I’d like the option of both.