I'm helping a non-profit with a program evaluation and we need data from the school district. They are recommending Coarsened Exact Matching, but also want to know how we are determining the sample sizes for the compared groups in the proposal. My understanding is you have the initial data from G0 and G1 and then after CEM you have the final sample size (the same for both) that you would use for the analysis. Am I misunderstanding something? What would the sample size be before matching? submitted by /u/Box-of-Nothing [visit reddit] [comments ..read more

Hi everyone! Apologies if I’m not using terms correctly but it’s my first time referring to this analysis. I’m interested in running an IRT analysis on a scale but I have no idea where to start. Not sure where to look or what software to use, and am hoping to get some guidance here. Would anyone know where I could get some step-by-step guide on how to go about it? submitted by /u/elysian-mochi [visit reddit] [comments ..read more

Hello, I wanted to ask for advice, which statistical test to use on this type of data. So I have an experiment, where I want to check the effect of certain treatments on the cells. I performed the experiment 4 times. So I have: control, treatment 1 and treatment 2. In my analysis of the cells, I get the percentages of cells that express certain markers, within a bigger population of the cells. No marker Marker A Marker B Both A and B Control 5% 40% 10% 45% Treatment A 5% 50% 8% 37% Treatment B 5% 55% 9% 31% Due to biology, the total number of cells in each experimental condition is not equ ..read more

If this isn't the appropriate subreddit for this type of question, please direct me to one which may be more suitable. I'm trying to figure out the best approach in how to compare packages of varying content that have a monetary value, but reward something with no monetary value. Let's say there are packages that cost varying amounts of money. Each package contains tickets to varying games with different probabilities. What is the best way to figure out which package would be the better "deal"? A few facts about this scenario: Each Package has a different monetary cost. Each Package conta ..read more

Hi, I just wanted to clarify whether the following experiment design is paired or parallel. I'd compare the protein purity produced by two different machines. This will be done by measuring the purity at 10 random time points for each process. (E.g. measure proteins produced by both machine x and y at hour 1, hour 4, etc.). So I'd have two observations for each time point I measure. At first I thought it was a parallel design since I’m testing two different groups (that is, two diffe machines with two different processes), and I have two different observations. But I'm starting to think they ..read more

What is the minimum amount of data points needed to do? Thank you in advance. submitted by /u/Zaddddyyyyy95 [visit reddit] [comments ..read more

Like it says on the cover. I am pretty sure I saw a post here a week or so ago where someone identified a published academic paper that included data sets that seemed to be generated by AI. I meant to save the post but I guess I didn't (if you can link it please let me know). But it got me thinking...have there been other examples of ai generated data that was obvious after someone ran (or re-ran) statistical analysis? Alternatively, does anyone have any examples of ai datasets being used for good in the world of statistics? submitted by /u/SignificantCitron [visit reddit] [comments ..read more

Is there anything philosophically wrong with reporting mean and standard deviation along with a p-value from something like the Wilcoxon signed rank test? submitted by /u/No_Dentist1380 [visit reddit] [comments ..read more

I see a study where patients were enrolled THEN checked for a biomarker, whether it was positive or negative (present or not present). 10 patients died out of 2000 in the non-positive group and 20/500 died in the positive group, and the patients were followed for 3 years. If I went to do a power analysis for a simile study, would “baseline event rate” be 10/2000, or would it be (10/2000) / 3? Or would it be (10+20) / (2000 + 500)? I don’t see any good definitions of what “baseline event rate” is which is why I’m confused! submitted by /u/MatchaLatte16oz [visit reddit] [comments ..read more

I'm in an unusual spot. Most of my past jobs have heavily emphasized the Bayesian approach to stats and experimentation. I haven't thought about the Frequentist approach since undergrad. Anyway, I'm on a new team and this came across my desk. https://www.microsoft.com/en-us/research/group/experimentation-platform-exp/articles/deep-dive-into-variance-reduction/ I have not thought about computing computing variances by hand in over a decade. I'm so used the mentality of 'just take <aggregate metric> from the posterior chain' or 'compute the posterior predictive distribution to see <met ..read more