Add ObjectStore::list_opts

[tustvold]

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

We should add an ObjectStore::list_opts to allow

• Specifying both a start offset and delimiter Expose list_paginated in object_store #7237
• Providing Extensions feat: add Extensions to object store PutOptions #7213

Describe the solution you'd like

I think the following API should work and eventually allow providing default implementations of list and list_with_delimiter that call through to list_opts

struct ListOptions {
    pub offset: Option<Path>,
    pub delimiter: bool,
    pub extensions: Extensions
}

fn list_opts(&self, opts: ListOptions) -> BoxStream<'static, Result<ListResult>>

Describe alternatives you've considered

We could expose an API that more explicitly exposes the paginated nature of the underlying APIs, however, such APIs are quite cumbersome to use, and wouldn't obviously translate to LocalFileSystem.

Additional context