Skip to content

[Bug] storage fallback strategy is ineffective #2671

@xianjingfeng

Description

@xianjingfeng

Code of Conduct

Search before asking

  • I have searched in the issues and found no similar issues.

Describe the bug

I found the storage fallback strategy is not working now, i don't know the casue currently

Affects Version(s)

0.9

Uniffle Server Log Output

[2025-11-13 17:14:36.225] [HadoopFlushEventThreadPool-45] [WARN] SingleStorageManager.write - Exception happened when write data for ShuffleDataFlushEvent: eventId=768165, appId=application_1748950399685_64161994_1763024148492, shuffleId=2, startPartition=1873, endPartition=1873, retryTimes=0, underStorage=HadoopStorage, isPended=false, ownedByHugePartition=false, try again
[2025-11-13 17:16:05.772] [FallBackFlushEventThreadPool-1] [WARN] SingleStorageManager.write - Exception happened when write data for ShuffleDataFlushEvent: eventId=768165, appId=application_1748950399685_64161994_1763024148492, shuffleId=2, startPartition=1873, endPartition=1873, retryTimes=1, underStorage=HadoopStorage, isPended=true, ownedByHugePartition=false, try again
[2025-11-13 17:17:38.346] [FallBackFlushEventThreadPool-3] [WARN] SingleStorageManager.write - Exception happened when write data for ShuffleDataFlushEvent: eventId=768165, appId=application_1748950399685_64161994_1763024148492, shuffleId=2, startPartition=1873, endPartition=1873, retryTimes=2, underStorage=HadoopStorage, isPended=true, ownedByHugePartition=false, try again
[2025-11-13 17:17:49.973] [FallBackFlushEventThreadPool-0] [WARN] ShuffleFlushManager.processFlushEvent - AppId application_1748950399685_64161994_1763024148492 was removed already, event:ShuffleDataFlushEvent: eventId=768165, appId=application_1748950399685_64161994_1763024148492, shuffleId=2, startPartition=1873, endPartition=1873, retryTimes=3, underStorage=HadoopStorage, isPended=true, ownedByHugePartition=false should be dropped

Uniffle Engine Log Output

Uniffle Server Configurations

rss.server.hybrid.storage.fallback.strategy.class org.apache.uniffle.server.storage.RotateStorageManagerFallbackStrategy

Uniffle Engine Configurations

Additional context

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions