Add Onnx Config for PoolFormer

[BakingBrains]

What does this PR do?

Fixes # (#16308)

Add changes to make PoolFormer models available for Onnx conversion.

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.

@chainyo

[BakingBrains]

I have ran
RUN_SLOW=1 pytest tests/onnx/test_onnx_v2.py -k "poolformer"

[BakingBrains]

Conversion output

[BakingBrains]

@chainyo @lewtun Any suggestions here?

Thanks and Regards.

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

[chainyo]

Thanks for working on this!

Don't forget to use $ make fixup command before pushing your work.

[BakingBrains]

Any updates on this PR?

[BakingBrains]

@chainyo Any updates here?

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.

[chainyo]

Hey @lewtun and @michaelbenayoun, we should merge this before the Optimum change.

Could you help on this?

[michaelbenayoun]

Hi @chainyo,
The change is already here, I think the PR can be merged once the conflicts are resolved.
Also @BakingBrains could you add it to Optimum as well? It should not require much effort. If not, I can make it myself.

[michaelbenayoun]

LGTM (after resolving conflicts)

[BakingBrains]

@michaelbenayoun Sure, I will add it to Optimum.

Thank you

[BakingBrains]

I tried to resolve the conflicts, but I think I messed up

[BakingBrains]

I just reopened a new pull request for the same with resolved conflicts, can you please check @michaelbenayoun
#20868

Thank you