Wearable inertial measurement units (IMUs) are used in gait analysis due to their discrete wearable attachment and long data recording possibilities within indoor and outdoor environments. Previously, lower back and shin/shank-based IMU algorithms detecting initial and final contact events (ICs-FCs) were developed and validated on a limited number of healthy young adults (YA), reporting that both IMU wear locations are suitable to use during indoor and outdoor gait analysis. However, the impact of age (e.g., older adults, OA), pathology (e.g., Parkinson′s Disease, PD) and/or environment (e.g., indoor vs. outdoor) on algorithm accuracy have not been fully investigated. Here, we examined IMU gait data from 128 participants (72-YA, 20-OA, and 36-PD) to thoroughly investigate the suitability of ICs-FCs detection algorithms (1 × lower back and 1 × shin/shank-based) for quantifying temporal gait characteristics depending on IMU wear location and walking environment. The level of agreement between algorithms was investigated for different cohorts and walking environments. Although mean temporal characteristics from both algorithms were significantly correlated for all groups and environments, subtle but characteristically nuanced differences were observed between cohorts and environments. The lowest absolute agreement level was observed in PD (ICC2,1 = 0.979, 0.806, 0.730, 0.980) whereas highest in YA (ICC2,1 = 0.987, 0.936, 0.909, 0.989) for mean stride, stance, swing, and step times, respectively. Absolute agreement during treadmill walking (ICC2,1 = 0.975, 0.914, 0.684, 0.945), indoor walking (ICC2,1 = 0.987, 0.936, 0.909, 0.989) and outdoor walking (ICC2,1 = 0.998, 0.940, 0.856, 0.998) was found for mean stride, stance, swing, and step times, respectively. Findings of this study suggest that agreements between algorithms are sensitive to the target cohort and environment. Therefore, researchers/clinicians should be cautious while interpreting temporal parameters that are extracted from inertial sensors-based algorithms especially for those with a neurological condition.