Leaderboard

  • Note: Technical report template is provided. Please refer to the recent update on the Home page
  • Note: The 3D Coordinates of viewpoints and objects (GPS) in the dataset cannot be used as input data. This is because the REVERIE challenge aims to encourage developing models that work like we humans. You can use rel_distance, rel_heading, and rel_elevation among viewpoints from the simulator. This means you do not have a global map at the beginning. If you prefer the GPS information, you can use algorithms (eg., SLAM) to estimate it, do pre-exploration, etc.
  • Note: Make sure you are using the new data. Check whether your object features are consistent with objects listed in the BBoxes folder.
  • Channel 1
  • TeamNav-SuccNav-OSuccNav-SPLNav-LengthRGSRGSPL
    Baseline_Ch114.4438.679.0223.65.163.27
    BPT65.8471.8350.2417.7222.5317.09
    Navigo*63.170.4347.019.0922.1717.02
    TouchFish61.4967.4845.7520.122.3616.81
    ProjectD61.3966.644.9921.1421.1915.7
    TeamKeio143.4258.0229.6718.2114.7110.33
    Lancer41.4654.7228.2219.6412.539.52
    NorthWarrior41.2853.7228.1719.8813.039.48
    GrooBoys39.8355.6427.3619.2612.59.44
    GingerGin39.0353.3627.0519.7513.219.37
    Dragon38.6648.2726.0716.6212.989.25
    Reapers36.7244.1525.4313.4411.649.11
    NDGMa28.8835.3525.6411.2912.459.09
    Kzio37.4442.0723.0818.4211.379.08
    Bevo36.8846.6524.0817.6311.759.05
    FirstFleet29.6237.8217.5415.2311.569.02
    Toath35.5444.6321.0615.0711.218.95
    EBmonk35.6841.3324.2215.5812.238.93
    Phoenix36.4642.0624.7616.112.188.89
    Aces35.2340.3823.1916.3810.648.67
    Arvehol34.1943.5225.6514.0110.448.52
    Alpha28.6342.2719.2215.3810.678.48
    Scorpion28.5244.8120.1214.710.718.47
    Saga28.4641.3520.0515.2311.038.44
    Commando28.3742.6321.3813.1710.338.19
    Thunder28.0540.8219.2614.4310.148.07
    ThreeZero28.2339.5620.1913.389.967.47
    Dun27.4330.0819.8313.429.837.45
    Zong27.3631.5221.2712.619.687.41
    Hemster28.1734.3520.6413.299.727.4
    Xpress27.5338.2919.3714.559.687.38
    TurfDog26.9235.4619.6714.819.817.26
    Chiladas26.6432.4321.4413.759.446.35
    Gafferty26.3334.2820.3614.118.526.24
    Sannas25.4833.6320.1412.068.486.09
    Titan24.3332.6518.7314.028.436.05
    Reds24.4831.6418.2212.768.266.03
    Beast25.1333.8717.8514.27.926.01
    Genesis25.3234.5919.0213.527.865.56
    Vapo25.7634.4119.2811.637.835.52
    Noel25.6332.2518.3710.847.925.46
    Elves25.5934.4618.3911.267.715.42
    Blizzard24.4533.5318.2611.577.465.39
    DesertEye25.3730.3917.2712.227.245.33
    Shophy24.5834.6918.3611.737.425.28
    Chub26.4633.3822.5810.737.135.21
    Grater25.4735.6619.4511.816.955.04
    Bullet25.5136.2621.6312.476.885.01
    Yamball23.6530.7218.1413.456.714.85
    KaiPai22.3927.6115.2312.846.564.74
    KMA20.2325.2916.1911.566.354.52
    Braver20.2124.3516.0112.466.594.13
    YeongJ18.5436.2410.2720.656.234.04

    Note: * Navigo uses ground truth depth to exclude objects that are 3 meters away from each viewpoint.

  • Channel 2
  • TeamNav-SuccNav-OSuccNav-SPLNav-LengthRGSRGSPL
    Baseline_Ch214.4438.679.0223.64.93.1
    BPT65.8471.8350.2417.7237.2128.36
    Navigo*63.170.4347.019.0935.426.47
    TouchFish61.4967.4845.7520.134.7725.77
    ProjectD61.3966.644.9921.1433.7924.89
    Findwell51.9557.1937.8217.3723.1616.52
    TeamKeio243.4258.0229.6718.2115.8510.96
    Bumblebee42.0357.3628.6218.0515.1410.31
    FirstFleet41.1252.1528.4518.2615.0210.26
    Lancer41.4654.7228.2219.6414.8610.2
    NorthWarrior41.2853.7228.1719.8814.7510.16
    GrooBoys39.8355.6427.3619.2614.7210.14
    GingerGin39.0353.3627.0519.7514.6110.11
    Dragon38.6648.2726.0716.6214.359.92
    Reapers36.7244.1525.4313.4413.659.88
    EBmonk35.6841.3324.2215.5813.149.41
    Phoenix36.4642.0624.7616.113.299.33
    Aces35.2340.3823.1916.3814.439.26
    Alpha28.6342.2719.2215.3812.118.89
    Scorpion28.5244.8120.1214.711.928.64
    Saga28.4641.3520.0515.2311.438.51
    Commando28.3742.6321.3813.1711.758.49
    Thunder28.0540.8219.2614.4311.668.13
    ThreeZero28.2339.5620.1913.3811.637.66
    Zong27.3631.5221.2712.6111.287.62
    Hemster28.1734.3520.6413.2911.437.45
    Xpress27.5338.2919.3714.5511.157.22
    TurfDog26.9235.4619.6714.8110.797.18
    Chiladas26.6432.4321.4413.7510.386.81
    Gafferty26.3334.2820.3614.1110.266.74
    Titan24.3332.6518.7314.029.896.55
    Yamball23.6530.7218.1413.459.816.43
    Reds24.4831.6418.2212.769.776.35
    Beast25.1333.8717.8514.29.676.26
    Genesis25.3234.5919.0213.529.415.83
    Vapo25.7634.4119.2811.639.415.74
    Noel25.6332.2518.3710.849.325.65
    Elves25.5934.4618.3911.269.355.47
    Blizzard24.4533.5318.2611.579.285.44
    DesertEye25.3730.3917.2712.229.195.38
    Shophy24.5834.6918.3611.739.315.31
    Chub26.4633.3822.5810.739.435.26
    Grater25.4735.6619.4511.819.255.13
    Bullet25.5136.2621.6312.479.375.06
    KMA20.2325.2916.1911.568.634.99

    Note: * Navigo uses ground truth depth to exclude objects that are 3 meters away from each viewpoint.