$ FILENAME=.secrets
$ git filter-branch --force --index-filter \
  "git rm --cached --ignore-unmatch $FILENAME" \
  --prune-empty --tag-name-filter cat -- --all

You need to force push the updates:

$ git push --force

If you have tags, then you also need to push the tags:

$ git push origin --force --tags