It is possible to set and change each property of the effects with a layer selection dropdown (such as Set Matte or Compound Arithmetic) via scripting, however the selection for 'Source / Mask / Effects & Masks' is currently inaccessible (via script).

Please reveal this dropdown property to the Extendscript API for all effects with a layer selection dropdown.

Screenshot of this inaccessible dropdown is attached.