6 i r t h y

This entire alpha reeks of #BadSurveyingPractices for the following reasons: 1. Low Response Rate: Only 4,284 out of 65,918 participants responded to the survey (6.5%), with 3,380 completions (5.1%). This low response rate risks non-response bias, as the sample may not represent the broader player base. 2. Underrepresentation of "No" Voters: Only 5.8% of playtesters were "No" voters (from the 2023 poll), despite 28.1% voting "No" originally. This underrepresentation minimizes critical feedback from dissenting players. 3. Leading Presentation of Results: The post emphasizes positive feedback (e.g., "77.69% feel more positive"), but these percentages are based on the 55% who already felt positive, not the entire sample. This nested framing exaggerates positivity and misleads readers. 4. Lack of Transparency on Negative Feedback: The survey results highlight positive responses but downplay or omit detailed negative feedback, such as the 24.46% neutral on Port Tasks or concerns about boats getting stuck, reducing the credibility of the analysis. 5. Self-Selection Bias: The survey was optional and in-game, likely attracting players already engaged or positive about Sailing. The blog notes that most participants don’t engage with OSRS on social media, potentially missing broader community sentiment. 6. Premature Conclusions: The post and blog draw optimistic conclusions (e.g., "core systems are on the right track") despite the Alpha stage and acknowledged issues like XP rates and boat mechanics, potentially ignoring the need for significant changes. These practices undermine the survey’s reliability and fairness, risking misrepresentation of community sentiment on the Sailing skill.