Category: datascience

  • Weekly Entering & Transitioning – Thread 02 Mar, 2026 – 09 Mar, 2026

    Weekly Entering & Transitioning – Thread 02 Mar, 2026 – 09 Mar, 2026 Welcome to this week’s entering & transitioning thread! This thread is for any questions about getting started, studying, or transitioning into the data science field. Topics include: Learning resources (e.g. books, tutorials, videos) Traditional education (e.g. schools, degrees, electives) Alternative education (e.g.…

  • So what do y’all think of the Block layoffs?

    So what do y’all think of the Block layoffs? My upcoming interview with Block got canceled, and I am in a bit of relief but at the same time it made me question where is the industry in general headed to. Block CEO is attributing the layoffs to AI. As an active job seeker and…

  • Time Series Themed Children’s Book

    Time Series Themed Children’s Book For the parents out there’s looking to share the joys of data collection, cleaning, time series modeling, and forecasting error with their little ones. Written completely in rhyme and all about using data to solve problems. Alternatively, Harry’s Lemonade Solution could be used to teach your parents a little bit…

  • The top 5 most common product analytics case interview questions asked in big tech interviews

    The top 5 most common product analytics case interview questions asked in big tech interviews Hey folks, You might remember me from my previous posts about my progression into big tech or my guide to passing A/B Test interview questions. Well, I’m back with what will hopefully be more helpful interview tips. These are tips…

  • My experience after final round interviews at 3 tech companies

    My experience after final round interviews at 3 tech companies Hey folks, this is an update from my previous post (here). You might also remember me for my previous posts about how to pass product analytics interviews in tech, and how to pass AB testing/Experimentation interviews. For context, I was laid off last year, took…

  • Weekly Entering & Transitioning – Thread 23 Feb, 2026 – 02 Mar, 2026

    Weekly Entering & Transitioning – Thread 23 Feb, 2026 – 02 Mar, 2026 Welcome to this week’s entering & transitioning thread! This thread is for any questions about getting started, studying, or transitioning into the data science field. Topics include: Learning resources (e.g. books, tutorials, videos) Traditional education (e.g. schools, degrees, electives) Alternative education (e.g.…

  • How to not get discouraged while searching for a job?

    How to not get discouraged while searching for a job? The market has not been forgiving, especially when it comes to interviews. I am not sure if anyone else has noticed, but companies seem to expect flawless interviews and coding rounds. I have faced a few rejections over the past couple of months, and it…

  • What should I tell the students about job opportunities?

    What should I tell the students about job opportunities? I am a data scientist with almost two years of experience. I mainly work on SQL, Pandas, Power BI dashboards, credit risk modeling, MLOps, and a small part of GenAI architecture using Redis workers. I have been invited to my college, where I completed my Masters…

  • Data Catalog Tool – Sanity Check

    Data Catalog Tool – Sanity Check submitted by /u/FirCoat [link] [comments] /u/FirCoat Go to original source

  • Roast my AB test analysis [A]

    Roast my AB test analysis [A] I have just finished up a sample analysis on an AB test dummy dataset, and would love feedback. The dataset is from Udacity’s AB Testing course. It tracks data on two landing page variations, treatment and control, with mean conversion rate as the defining metric. In my analysis, I…

  • Weekly Entering & Transitioning – Thread 16 Feb, 2026 – 23 Feb, 2026

    Weekly Entering & Transitioning – Thread 16 Feb, 2026 – 23 Feb, 2026 Welcome to this week’s entering & transitioning thread! This thread is for any questions about getting started, studying, or transitioning into the data science field. Topics include: Learning resources (e.g. books, tutorials, videos) Traditional education (e.g. schools, degrees, electives) Alternative education (e.g.…

  • LLMs for data pipelines without losing control (API → DuckDB in ~10 mins)

    LLMs for data pipelines without losing control (API → DuckDB in ~10 mins) Hey folks, I’ve been doing data engineering long enough to believe that “real” pipelines meant writing every parser by hand, dealing with pagination myself, and debugging nested JSON until it finally stopped exploding. I’ve also been pretty skeptical of the “just prompt…

  • Best technique for training models on a sample of data?

    Best technique for training models on a sample of data? Due to memory limits on my work computer I’m unable to train machine learning models on our entire analysis dataset. Given my data is highly imbalanced I’m under-sampling from the majority class of the binary outcome. What is the proper method to train ML models…

  • What differentiates a high impact analytics function from one that just produces dashboards?

    What differentiates a high impact analytics function from one that just produces dashboards? I’m curious to hear from folks who’ve worked inside or alongside analytics teams. In your experience, what actually separates analytics groups that influence business decisions from those that mostly deliver reporting? submitted by /u/Proof_Wrap_2150 [link] [comments] /u/Proof_Wrap_2150 Go to original source

  • Where do you see HR/People Analytics evolving over the next 5 years?

    Where do you see HR/People Analytics evolving over the next 5 years? Curious how practitioners see the field shifting, particularly around: AI integration Predictive workforce modeling Skills-based org design Ethical boundaries Data ownership changes HR decision automation What capabilities do you think will define leading functions going forward? submitted by /u/Proof_Wrap_2150 [link] [comments] /u/Proof_Wrap_2150 Go…

  • Weekly Entering & Transitioning – Thread 09 Feb, 2026 – 16 Feb, 2026

    Weekly Entering & Transitioning – Thread 09 Feb, 2026 – 16 Feb, 2026 Welcome to this week’s entering & transitioning thread! This thread is for any questions about getting started, studying, or transitioning into the data science field. Topics include: Learning resources (e.g. books, tutorials, videos) Traditional education (e.g. schools, degrees, electives) Alternative education (e.g.…

  • How I scraped 5.3 million jobs (including 5,335 data science jobs)

    How I scraped 5.3 million jobs (including 5,335 data science jobs) Background During my PhD in Data Science at Stanford, I got sick and tired of ghost jobs & 3rd party offshore agencies on LinkedIn & Indeed. So I wrote a script that fetches jobs from 30k+ company websites’ career pages and uses GPT4o-mini to…

  • Thoughts about going from Senior data scientist at company A to Senior Data Analyst at Company B

    Thoughts about going from Senior data scientist at company A to Senior Data Analyst at Company B The senior data analyst at company B is significant higher pay ($50k/year more) and scope seems to be bigger with more ownership What kind of setback (if any) does losing the data scientist title have? submitted by /u/StatGoddess…

  • Retraining strategy with evolving classes + imbalanced labels?

    Retraining strategy with evolving classes + imbalanced labels? Hi all — I’m looking for advice on the best retraining strategy for a multi-class classifier in a setting where the label space can evolve. Right now I have about 6 labels, but I don’t know how many will show up over time, and some labels appear…

  • Finding myself disillusioned with the quality of discussion in this sub

    Finding myself disillusioned with the quality of discussion in this sub I see multiple highly-upvoted comments per day saying things like “LLMs aren’t AI,” demonstrating a complete misunderstanding of the technical definitions of these terms. Or worse, comments that say “this stuff isn’t AI, AI is like *insert sci-fi reference*.” And this is just comments…

  • Weekly Entering & Transitioning – Thread 02 Feb, 2026 – 09 Feb, 2026

    Weekly Entering & Transitioning – Thread 02 Feb, 2026 – 09 Feb, 2026 Welcome to this week’s entering & transitioning thread! This thread is for any questions about getting started, studying, or transitioning into the data science field. Topics include: Learning resources (e.g. books, tutorials, videos) Traditional education (e.g. schools, degrees, electives) Alternative education (e.g.…

  • Am I drifting away from Data Science, or building useful foundations? (2 YOE working in a startup, no coding)

    Am I drifting away from Data Science, or building useful foundations? (2 YOE working in a startup, no coding) I’m looking for some career perspective and would really appreciate advice from people working in or around data science. I’m currently not sure where exactly is my career heading and want to start a business eventually…

  • Brainstorming around the visualization of customer segment data

    Brainstorming around the visualization of customer segment data submitted by /u/SingerEast1469 [link] [comments] /u/SingerEast1469 Go to original source

  • What separates data scientists who earn a good living (100k-200k) from those who earn 300k+ at FAANG?

    What separates data scientists who earn a good living (100k-200k) from those who earn 300k+ at FAANG? Is it just stock options and vesting? Or is it just FAANG is a lot of work. Why do some data scientists deserve that much? I work at a Fortune 500 and the ceiling for IC data scientists…

  • Building “Auto-Analyst” — A data analytics AI agentic system

    Building “Auto-Analyst” — A data analytics AI agentic system submitted by /u/phicreative1997 [link] [comments] /u/phicreative1997 Go to original source

  • Weekly Entering & Transitioning – Thread 26 Jan, 2026 – 02 Feb, 2026

    Weekly Entering & Transitioning – Thread 26 Jan, 2026 – 02 Feb, 2026 Welcome to this week’s entering & transitioning thread! This thread is for any questions about getting started, studying, or transitioning into the data science field. Topics include: Learning resources (e.g. books, tutorials, videos) Traditional education (e.g. schools, degrees, electives) Alternative education (e.g.…

  • Weekly Entering & Transitioning – Thread 19 Jan, 2026 – 26 Jan, 2026

    Weekly Entering & Transitioning – Thread 19 Jan, 2026 – 26 Jan, 2026 Welcome to this week’s entering & transitioning thread! This thread is for any questions about getting started, studying, or transitioning into the data science field. Topics include: Learning resources (e.g. books, tutorials, videos) Traditional education (e.g. schools, degrees, electives) Alternative education (e.g.…

  • Weekly Entering & Transitioning – Thread 12 Jan, 2026 – 19 Jan, 2026

    Weekly Entering & Transitioning – Thread 12 Jan, 2026 – 19 Jan, 2026 Welcome to this week’s entering & transitioning thread! This thread is for any questions about getting started, studying, or transitioning into the data science field. Topics include: Learning resources (e.g. books, tutorials, videos) Traditional education (e.g. schools, degrees, electives) Alternative education (e.g.…

  • Weekly Entering & Transitioning – Thread 05 Jan, 2026 – 12 Jan, 2026

    Weekly Entering & Transitioning – Thread 05 Jan, 2026 – 12 Jan, 2026 Welcome to this week’s entering & transitioning thread! This thread is for any questions about getting started, studying, or transitioning into the data science field. Topics include: Learning resources (e.g. books, tutorials, videos) Traditional education (e.g. schools, degrees, electives) Alternative education (e.g.…

  • [Official] 2025 End of Year Salary Sharing thread

    [Official] 2025 End of Year Salary Sharing thread This is the official thread for sharing your current salaries (or recent offers). See last year’s Salary Sharing thread here. Please only post salaries/offers if you’re including hard numbers, but feel free to use a throwaway account if you’re concerned about anonymity. You can also generalize some…

  • Learning Python by doing projects: What does that even mean?

    Learning Python by doing projects: What does that even mean? I’m learning Python and considering this approach: choose a real dataset, frame a question I want to answer, then work toward it step by step by breaking it into small tasks and researching each step as needed. For those of you who are already comfortable…

  • Tips for standing out in this market?

    Tips for standing out in this market? Hey all, I just finished my master’s in data science last month and I want to see what it takes to break into a mid level DS role. I haven’t had a chance to sterilize my resume yet (2 young kids and a lot of recent travel), but…

  • Which class should I take to help me get a job?

    Which class should I take to help me get a job? I’m in my final semester of my MS program and am deciding between Spatial and Non-Parametric statistics. I feel like spatial is less common but would make me stand out more for jobs specifically looking for spatial whereas NP would be more common but…

  • Weekly Entering & Transitioning – Thread 29 Dec, 2025 – 05 Jan, 2026

    Weekly Entering & Transitioning – Thread 29 Dec, 2025 – 05 Jan, 2026 Welcome to this week’s entering & transitioning thread! This thread is for any questions about getting started, studying, or transitioning into the data science field. Topics include: Learning resources (e.g. books, tutorials, videos) Traditional education (e.g. schools, degrees, electives) Alternative education (e.g.…

  • Modern Git-aware File Tree and global search/replace in Jupyter

    Modern Git-aware File Tree and global search/replace in Jupyter I used jupyter lab for years, but the file browser menu is lack of some important features like tree view/aware of git status; I tried some of the old 3rd extensions but none of them fit those modern demands which most of editors/IDE have(like vscode) so…

  • What skills did you learn on the job this past year?

    What skills did you learn on the job this past year? What skills did you actually learn on the job this past year? Not from self-study or online courses, but through live hands-on training or genuinely challenging assignments. My hunch is that learning opportunities have declined recently, with many companies leaning on “you own your…

  • Are some people really as busy as they really look?

    Are some people really as busy as they really look? There is someone I have to work together and we both work remotely. I’m a data scientist and he is a product manager. This person appears to be always busy. His Slack status is either on a huddle or on a meeting. He is probably…

  • PhD microbiologist pivoting to GCC data analytics. Is a master’s needed or portfolio and projects sufficient?

    PhD microbiologist pivoting to GCC data analytics. Is a master’s needed or portfolio and projects sufficient? I am finishing a wet-lab microbiology PhD. Over the last year I realised that I prefer data work. I use R, Excel and command line regularly and want to move toward analytics roles in industry rather than academic biology.…

  • Weekly Entering & Transitioning – Thread 22 Dec, 2025 – 29 Dec, 2025

    Weekly Entering & Transitioning – Thread 22 Dec, 2025 – 29 Dec, 2025 Welcome to this week’s entering & transitioning thread! This thread is for any questions about getting started, studying, or transitioning into the data science field. Topics include: Learning resources (e.g. books, tutorials, videos) Traditional education (e.g. schools, degrees, electives) Alternative education (e.g.…

  • workforce moving to oversee

    workforce moving to oversee My company is investing more and more in its overseas workforce, mostly in India. For every one job posted in the U.S., there are about ten in India. Is my company an exception, or is this happening everywhere? submitted by /u/Alarmed-Reporter-230 [link] [comments] /u/Alarmed-Reporter-230 Go to original source

  • A memory effecient TF-IDF project in Python to vectorize datasets large than RAM

    A memory effecient TF-IDF project in Python to vectorize datasets large than RAM Re-designed at C++ level, this library can easily process datasets around 100GB and beyond on as small as a 4GB memory It does have its constraints but the outputs are comparable to sklearn’s output fasttfidf submitted by /u/mrnerdy59 [link] [comments] /u/mrnerdy59 Go…

  • New Data Science Team Lead struggling with aggressive PM on timelines and model expectations

    New Data Science Team Lead struggling with aggressive PM on timelines and model expectations I’m a data scientist who was recently promoted to be a data science team lead. Overall I enjoy the role, but I’m running into a recurring challenge with a very aggressive product manager (also a leader) that I’m not sure how…

  • How complex are your experiment setups?

    How complex are your experiment setups? Are you all also just running t tests or are yours more complex? How often do you run complex setups? I think my org wrongly only runs t tests and are not understanding of the downfalls of defaulting to those submitted by /u/ds_contractor [link] [comments] /u/ds_contractor Go to original…

  • Weekly Entering & Transitioning – Thread 15 Dec, 2025 – 22 Dec, 2025

    Weekly Entering & Transitioning – Thread 15 Dec, 2025 – 22 Dec, 2025 Welcome to this week’s entering & transitioning thread! This thread is for any questions about getting started, studying, or transitioning into the data science field. Topics include: Learning resources (e.g. books, tutorials, videos) Traditional education (e.g. schools, degrees, electives) Alternative education (e.g.…

  • I got three offers from a two month job search – here’s what I wish I knew earlier

    I got three offers from a two month job search – here’s what I wish I knew earlier There’s a lot of doom and gloom on reddit and elsewhere about the current state of the job market. And yes, it’s bad. But reading all these stories of people going months and years without getting a…

  • Has anyone tried training models on raw discussions instead of curated datasets?

    Has anyone tried training models on raw discussions instead of curated datasets? I’ve always followed the usual advice when training models, like clean the data, normalize everything, remove noise, structure it nicely Recently I tried something different. Instead of polished datasets, I fed models long, messy discussion threads, real conversations, people arguing, correcting themselves, misunderstanding…

  • While 72% of Executives Back AI, Public Trust Is Tanking

    While 72% of Executives Back AI, Public Trust Is Tanking submitted by /u/disforwork [link] [comments] /u/disforwork Go to original source

  • Gemini Deep Research: Autonomous Intelligence for Enterprise Research

    Gemini Deep Research: Autonomous Intelligence for Enterprise Research submitted by /u/WarChampion90 [link] [comments] /u/WarChampion90 Go to original source

  • Inferential Statistics on long-form census data from stats can

    Inferential Statistics on long-form census data from stats can I am using the following tool https://www150.statcan.gc.ca/t1/tbl1/en/tv.action?pid=9810065601 to query Statistics Canada and get data from the long-form census. However, since it’s a census of 25% of the population, there is a need for inferential statistics. That being said in order to do inferential statistics on the…

  • Weekly Entering & Transitioning – Thread 08 Dec, 2025 – 15 Dec, 2025

    Weekly Entering & Transitioning – Thread 08 Dec, 2025 – 15 Dec, 2025 Welcome to this week’s entering & transitioning thread! This thread is for any questions about getting started, studying, or transitioning into the data science field. Topics include: Learning resources (e.g. books, tutorials, videos) Traditional education (e.g. schools, degrees, electives) Alternative education (e.g.…

  • Lost and Feel Like a Fraud

    Lost and Feel Like a Fraud This might not be the appropriate place to say this, but I honestly feel like the biggest fraud ever. If I could go back, I don’t think I would have went into data science. I did my undergraduate in biology, and then did a masters in data science. I’ve…

  • MLE coding rounds (UK)

    MLE coding rounds (UK) I’m a data scientist transitioning to ML-AI Engineer roles. What kind of coding questions-rounds should I expect? I’ve heard that it’s a mixed bag, can be leetcode, can be Pytorch,tf for all ML related I’ve also heard about building ML concepts-algos from scratch using numpy etc. Or even an ML pipeline…

  • DS audiobook recommendations?

    DS audiobook recommendations? I have a very, very long road trip ahead of me. I would like recommendations for a DS audiobook that can help make the ride easier. submitted by /u/Cross_examination [link] [comments] /u/Cross_examination Go to original source

  • Weekly Entering & Transitioning – Thread 01 Dec, 2025 – 08 Dec, 2025

    Weekly Entering & Transitioning – Thread 01 Dec, 2025 – 08 Dec, 2025 Welcome to this week’s entering & transitioning thread! This thread is for any questions about getting started, studying, or transitioning into the data science field. Topics include: Learning resources (e.g. books, tutorials, videos) Traditional education (e.g. schools, degrees, electives) Alternative education (e.g.…

  • MSE-DS or OMSCS?

    MSE-DS or OMSCS? I’ve gotten a lot of mixed responses about this on other subreddits, so I wanted to ask here I was recently accepted to UPenn’s online part-time MSE-DS program. I graduated from college this past May from a top 20 school with a degree in data science. To be honest, I originally applied…

  • Everyone Can ‘Code’ with AI Now, According to Google—But Tech Workers Aren’t Fully Convinced

    Everyone Can ‘Code’ with AI Now, According to Google—But Tech Workers Aren’t Fully Convinced Have any data scientists here worked with AI for coding? Do you agree with experts’ skepticism in using it for high-level tasks? submitted by /u/disforwork [link] [comments] /u/disforwork Go to original source

  • ggplotly – A Grammar of Graphics implementation in Python/Plotly

    ggplotly – A Grammar of Graphics implementation in Python/Plotly https://github.com/bbcho/ggplotly As a fun project, I decided to try and replicate ggplot2 in plotly and python. I know that plotnine exists, but I like the interactivity of plotly. Let me know what you think. Coverage isn’t 100% but you can do most things. I tried to…

  • Shap or LGBM gain for feature selection?

    Shap or LGBM gain for feature selection? Which one do you use during recursive feature elimination or forward/backward selection? I’ve always used gain and only used shap for analytics on model predictions, but came across some shap values recommendations. Bonus question: have you used “null importance” / permutation method? Fitting models with shuffled targets to…

  • Weekly Entering & Transitioning – Thread 24 Nov, 2025 – 01 Dec, 2025

    Weekly Entering & Transitioning – Thread 24 Nov, 2025 – 01 Dec, 2025 Welcome to this week’s entering & transitioning thread! This thread is for any questions about getting started, studying, or transitioning into the data science field. Topics include: Learning resources (e.g. books, tutorials, videos) Traditional education (e.g. schools, degrees, electives) Alternative education (e.g.…

  • Are LeetCode heavy Interviews becoming the norm for DS Modeling roles?

    Are LeetCode heavy Interviews becoming the norm for DS Modeling roles? I’ve been actively searching for DS Modeling roles again, and wow the landscape has changed a lot since the last time I was on the market. It seems like leetcode style interviews have become way more common. I’ve already failed or barely passed several…

  • How long should I stay at my first job if I dislike the city?

    How long should I stay at my first job if I dislike the city? I recently just got my bachelors from Berkeley in data science, and I recently started a new job in Boston. I’m super grateful for this job opportunity because I applied to probably 1k jobs and this was the only good offer…

  • Indeed’s Job Report Shows 13% YoY Drop in Data & Analytics Roles

    Indeed’s Job Report Shows 13% YoY Drop in Data & Analytics Roles “Roles like business analyst, data analyst, data scientist, and BI developer are drawing large talent pools that outpace the number of job postings, creating a fiercely competitive market.” do you agree with these findings – are data & analytics roles the hardest-hit in…

  • Will there be a discount for Physical O’Reilly Media books?

    Will there be a discount for Physical O’Reilly Media books? Will there be a discount for Physical O’Reilly Media books? Hello. Not sure if this is the best place to post this question so let me know. Does anyone know if there will be some Black Friday discount for Physical O’Reilly Media books somewhere? I…

  • Weekly Entering & Transitioning – Thread 17 Nov, 2025 – 24 Nov, 2025

    Weekly Entering & Transitioning – Thread 17 Nov, 2025 – 24 Nov, 2025 Welcome to this week’s entering & transitioning thread! This thread is for any questions about getting started, studying, or transitioning into the data science field. Topics include: Learning resources (e.g. books, tutorials, videos) Traditional education (e.g. schools, degrees, electives) Alternative education (e.g.…

  • Where to Go After Data Science: Unconventional / Weird Exits?

    Where to Go After Data Science: Unconventional / Weird Exits? Data science careers often feel like they funnel into the same few paths—FAANG, ML/AI engineering, or analytics leadership—but people actually branch into wildly unexpected directions. I’m curious about those off-the-beaten-path exits: roles in unexpected industries, analytics-adjacent pivots, international moves, or entirely new ventures. Would love…

  • Meta’s top AI researchers thinks LLMs are a dead end. Do many people here feel the same way from a technical perspective?

    Meta’s top AI researchers thinks LLMs are a dead end. Do many people here feel the same way from a technical perspective? submitted by /u/sext-scientist [link] [comments] /u/sext-scientist Go to original source

  • Tech Is Shrinking… and Growing? The 2026 Job Market Plot Twist.

    Tech Is Shrinking… and Growing? The 2026 Job Market Plot Twist. do you agree with the article that the ‘shrinking’ side is only for the short-term? what’s your own outlook? submitted by /u/nullstillstands [link] [comments] /u/nullstillstands Go to original source

  • UPenn mse-ds or berkeley mids?

    UPenn mse-ds or berkeley mids? I have been very fortunate to get into both programs, but I’m having a hard time deciding between the two. I applied to these two programs half a year ago when I was a new grad struggling to land a job. It was my last resort. But after 1k applications,…

  • Weekly Entering & Transitioning – Thread 10 Nov, 2025 – 17 Nov, 2025

    Weekly Entering & Transitioning – Thread 10 Nov, 2025 – 17 Nov, 2025 Welcome to this week’s entering & transitioning thread! This thread is for any questions about getting started, studying, or transitioning into the data science field. Topics include: Learning resources (e.g. books, tutorials, videos) Traditional education (e.g. schools, degrees, electives) Alternative education (e.g.…

  • How to Decide Between Regression and Time Series Models for “Forecasting”?

    How to Decide Between Regression and Time Series Models for “Forecasting”? Hi everyone, I’m trying to understand intuitively when it makes sense to use a time series model like SARIMAX versus a simpler approach like linear regression, especially in cases of weak autocorrelation. For example, in wind power generation forecasting, energy output mainly depends on…

  • LLMs vs DSLMs — has anyone shown significant improvements when applying this in companies?

    LLMs vs DSLMs — has anyone shown significant improvements when applying this in companies? I’ve been hearing a lot about DSLMs. We’ve stuck with the larger LLMs like GPT. Has anyone seen significant improvements with the DSLMs instead? https://devnavigator.com/2025/11/07/the-lifecycle-of-a-domain-specific-language-model/ submitted by /u/WarChampion90 [link] [comments] /u/WarChampion90 Go to original source

  • Questions about ARIMA modelling

    Questions about ARIMA modelling I am facing weird issue trying to model my NET_DEMAND. I have done unit roots tests and noticed that two levels of differencing is required and 1 level of seasonal differencing is required. But after that when I am trying to plot the ACF and PACF plots I am not seeing…

  • Free Learning Paths for Data Analysts, Data Scientists, and Data Engineers – Using 100% Open Resources

    Free Learning Paths for Data Analysts, Data Scientists, and Data Engineers – Using 100% Open Resources Hey, I’m Ryan, and I’ve created https://www.datasciencehive.com/learning-paths A platform offering free, structured learning paths for data enthusiasts and professionals alike. The current paths cover: • Data Analyst: Learn essential skills like SQL, data visualization, and predictive modeling. • Data…

  • Weekly Entering & Transitioning – Thread 03 Nov, 2025 – 10 Nov, 2025

    Weekly Entering & Transitioning – Thread 03 Nov, 2025 – 10 Nov, 2025 Welcome to this week’s entering & transitioning thread! This thread is for any questions about getting started, studying, or transitioning into the data science field. Topics include: Learning resources (e.g. books, tutorials, videos) Traditional education (e.g. schools, degrees, electives) Alternative education (e.g.…

  • How would you turn a working Jupyter pipeline into a small web app?

    How would you turn a working Jupyter pipeline into a small web app? I’ve inherited a few data-engineering notebooks that work end-to-end. I want to (1) extract the logic into a testable Python package and (2) put a minimal GUI on top so non-technical teammates can run it with parameters and download outputs. Constraints: Python…

  • Is it too early to accept an internship offer?

    Is it too early to accept an internship offer? I’m a junior studying Data Analytics and Data Engineering at a solid state school. I’ve been a Data Analyst at my university’s career services for the past year, and previously interned as a Data & Business Analytics Intern at a regional credit union. I just got…

  • Has anyones company successfully implemented what is being described as ACP or an AI Mesh?

    Has anyones company successfully implemented what is being described as ACP or an AI Mesh? Has anyones company implemented what is generally described as ACP or what McKinsey describes as an AI Mesh? The concept is a centralized space for AI Agents to “talk to each other”. The link below is a general infographic comparing…

  • schwab API usage from AWS

    schwab API usage from AWS Hello everyone, I want to create an app that places stock sales based on triggers from AWS (where all my code resides). I am not sure how can I get authorization tokens from withing AWS for schwab API. Does anyone have experience with schwab ? submitted by /u/Amazing_Alarm6130 [link] [comments]…

  • Weekly Entering & Transitioning – Thread 27 Oct, 2025 – 03 Nov, 2025

    Weekly Entering & Transitioning – Thread 27 Oct, 2025 – 03 Nov, 2025 Welcome to this week’s entering & transitioning thread! This thread is for any questions about getting started, studying, or transitioning into the data science field. Topics include: Learning resources (e.g. books, tutorials, videos) Traditional education (e.g. schools, degrees, electives) Alternative education (e.g.…

  • Anyone looking to read the third edition of Deep Learning With Python?

    Anyone looking to read the third edition of Deep Learning With Python? The book is now available to read online for free: https://deeplearningwithpython.io/chapters/ submitted by /u/yaymayhun [link] [comments] /u/yaymayhun Go to original source

  • The Great Stay — Here’s the New Reality for Tech Workers

    The Great Stay — Here’s the New Reality for Tech Workers Do you think you’re part of this new phenomenon called The Great Stay? submitted by /u/KitchenTaste7229 [link] [comments] /u/KitchenTaste7229 Go to original source

  • What’s next for a 11 YOE data scientist?

    What’s next for a 11 YOE data scientist? Hi folks, Hope you’re having a great day wherever you are in the world. Context: I’ve been in the data science industry for the past 11 years. I started my career in telecom, where I worked extensively on time series analysis and data cleaning using R, Java,…

  • Any other free options that are similar to ShotBot?

    Any other free options that are similar to ShotBot? submitted by /u/Party_Bus_3809 [link] [comments] /u/Party_Bus_3809 Go to original source

  • Weekly Entering & Transitioning – Thread 20 Oct, 2025 – 27 Oct, 2025

    Weekly Entering & Transitioning – Thread 20 Oct, 2025 – 27 Oct, 2025 Welcome to this week’s entering & transitioning thread! This thread is for any questions about getting started, studying, or transitioning into the data science field. Topics include: Learning resources (e.g. books, tutorials, videos) Traditional education (e.g. schools, degrees, electives) Alternative education (e.g.…

  • How to perform synthetic control for multiple treated units? What are the things to keep in mind while performing it? Also, what python package i could use? Also have questions about metrics

    How to perform synthetic control for multiple treated units? What are the things to keep in mind while performing it? Also, what python package i could use? Also have questions about metrics Hi I have never done Synthetic control, i want to work on a small project (like small data. My task is to find…

  • Anyone else tired of the non-stop LLM hype in personal and/or professional life?

    Anyone else tired of the non-stop LLM hype in personal and/or professional life? I have a complex relationship with LLMs. At work, I’m told they’re the best thing since the invention of the internet, electricity, or [insert other trite comparison here], and that I’ll lose my job to people who do use them if I…

  • I built a project and I thought I might share it with the group

    I built a project and I thought I might share it with the group Disclaimer: It’s UK focused. Hi everyone, When I was looking to buy a house, a big annoyance I had was that I couldn’t easily tell if I was getting value for money. Although, in my opinion, any property is expensive as…

  • Transformers, Time Series, and the Myth of Permutation Invariance

    Transformers, Time Series, and the Myth of Permutation Invariance There’s a common misconception in ML/DL that Transformers shouldn’t be used for forecasting because attention is permutation-invariant. Latest evidence shows the opposite, such as Google’s latest model, where the experiments show the model performs just as well with or without positional embeddings. You can find an…

  • Weekly Entering & Transitioning – Thread 13 Oct, 2025 – 20 Oct, 2025

    Weekly Entering & Transitioning – Thread 13 Oct, 2025 – 20 Oct, 2025 Welcome to this week’s entering & transitioning thread! This thread is for any questions about getting started, studying, or transitioning into the data science field. Topics include: Learning resources (e.g. books, tutorials, videos) Traditional education (e.g. schools, degrees, electives) Alternative education (e.g.…

  • From data scientist to a new role ?

    From data scientist to a new role ? Hi everyone, I’m 25, currently working as a Data Scientist & AI Engineer at a large Space company in Europe, with ~2.5 years of experience. My focus has been on LLM R&D, RAG pipelines, satellite telemetry anomaly detection, surrogate modeling, and some FPGA-compatible ML for onboard systems.…

  • Clustring very different values

    Clustring very different values I have 200 observations, 3 variables ( somewhat correlated).For v1, the median is 300 dollars. but I have a really long tail. when I do the histogram, 100 obs are near 0 and the others form a really long tail, even when I cap outliers. what is best way to cluster?…

  • What should I ask my potential managers when choosing between two jobs?

    What should I ask my potential managers when choosing between two jobs? I’m deciding between two mid-level data science offers at large tech companies. These are more applied scientist type of roles than analytics. Comp and level are similar, so I’m really trying to figure out which one will set me up for a stronger…

  • Free data set that links company to type of activity?

    Free data set that links company to type of activity? Best ressource to classify for example: walmart. food ( top classification) supermarket ( sub classification). I work with european companies also. thanks. submitted by /u/Due-Duty961 [link] [comments] /u/Due-Duty961 Go to original source

  • Weekly Entering & Transitioning – Thread 06 Oct, 2025 – 13 Oct, 2025

    Weekly Entering & Transitioning – Thread 06 Oct, 2025 – 13 Oct, 2025 Welcome to this week’s entering & transitioning thread! This thread is for any questions about getting started, studying, or transitioning into the data science field. Topics include: Learning resources (e.g. books, tutorials, videos) Traditional education (e.g. schools, degrees, electives) Alternative education (e.g.…

  • Why am I not getting responses?

    Why am I not getting responses? As mentioned before, I can’t use the weekly transition because it doesn’t allow pictures. I appreciate your help last time when I asked. I’ve implemented your recommendations but I’m still not getting responses. I’ve added a completely new ML-based project, fixed mistakes, revamped the layout and I’m still not…

  • Do you know interesting datasets for kriging?

    Do you know interesting datasets for kriging? Hi guys, I need to do a project using many linear models and I’m looking for a dataset. Ideally something interesting with lots of numerical variables, especially one where kriging could be applied. If you have any dataset suggestions or interesting research questions I could build the project…

  • What could be my next career progression?

    What could be my next career progression? Hello, I’m 26 years old been working as a junior data scientist in marketing for the past two years and I’m a bit bored/ have no idea how to progress further in my career. Currently I do end to end modeling, from gathering data up to production (not…

  • Are LLMs necessary to get a job?

    Are LLMs necessary to get a job? For someone laid off in 2023 before the LLM/Agent craze went mainstream, do you think I need to learn LLM architecture? Are certs or github projects worth anything as far as getting through the filters and/or landing a job? I have 10 YOE. I specialized in machine learning…

  • Weekly Entering & Transitioning – Thread 29 Sep, 2025 – 06 Oct, 2025

    Weekly Entering & Transitioning – Thread 29 Sep, 2025 – 06 Oct, 2025 Welcome to this week’s entering & transitioning thread! This thread is for any questions about getting started, studying, or transitioning into the data science field. Topics include: Learning resources (e.g. books, tutorials, videos) Traditional education (e.g. schools, degrees, electives) Alternative education (e.g.…

  • What interesting projects are you working on that are not related to AI?

    What interesting projects are you working on that are not related to AI? Share links if possible. submitted by /u/yaymayhun [link] [comments] /u/yaymayhun Go to original source