Just as a follow up if anyone needs this info in the future, you can do it using JSON like this:
https://www.c-sharpcorner.com/article/sharepoint-list-items-row-actions-with-column-formatting/
E.g (in the column formatting):
> {
"$schema": "https://developer.microsoft.com/json-schemas/sp/column-formatting.schema.json", "elmType": "button", "customRowAction": { "action": "editProps" }, "attributes": { "class": "ms-fontColor-themePrimary ms-fontColor-themeDark--hover", "title": "Edit Item" }, "style": { "border": "none", "background-color": "transparent", "cursor": "pointer" }, "children": [ { "elmType": "span", "attributes": { "iconName": "Edit", "class": "ms-font-xxl" } } ] }