This is cut and paste from Redit
Deducer is designed to be a free easy to use alternative to proprietary data analysis software such as SPSS, JMP, and Minitab. It has a menu system to do common data manipulation and analysis tasks, and an excel-like spreadsheet in which to view and edit data frame
Rattle (the R Analytic Tool To Learn Easily) provides a Gnome (RGtk2) based interface to R functionality for data mining. The aim is to provide a simple and intuitive interface that allows a user to quickly load data from a CSV file (or via ODBC), transform and explore the data, build and evaluate models, and export models as PMML (predictive modelling markup language) or as scores. All of this with knowing little about R.
Description: KDE frontend to the R statistics language RKWard aims to become an easy to use, transparent frontend to R, a powerful system for statistical computation and graphics. Besides a convenient GUI for the most important statistical functions, future versions will also provide seamless integration with an office-suite.
Above utilities are not in Debian Package Manager .
Well I tried Debian Edu Mathematics.
It looks like Text Editors are used to develop statistics in Linux.
It looks like Linux has data reader for other statistical packages like SPSS and SAS but there are commercial Linux packages available.