My Blog

Author: saqibkhan

  • What is a package in R, and how do you install and load packages?

    An R package is a collection of functions, code, data, and documentation, representing an extension of the R programming language and designed for solving specific kinds of tasks. R comes with a bunch of preinstalled packages, and other packages can be installed by users from repositories. The most popular centralized repository storing thousands of various R packages is called Comprehensive R Archive Network (CRAN).

    To install an R package directly from CRAN, we need to pass the package name enclosed in quotation marks to the install.packages() function, as follows: install.packages("package_name"). To install more than one package from CRAN in one go, we need to use a character vector containing the package names enclosed in quotation marks, as follows: install.packages(c("package_name_1", "package_name_2"). To install an R package manually, we need first to download the package as a zip file on our computer and then run the install.packages() function:

    install.packages("path_to_the_locally_stored_zipped_package_file", repos=NULL, type="source")Powered By

    To load an installed R package in the working R environment, we can use either library() or require() functions. Each of them takes in the package name without quotation marks and loads the package, e.g., library(caret). However, the behavior of these functions is different when they can’t find the necessary package: library() throws an error and stops the program execution, while require() outputs a warning and continues the program execution.

  • How to import data in R?

    The base R provides essential functions for importing data:

    • read.table()—the most general function of the base R for importing data, takes in tabular data with any kind of field separators, including specific ones, such as |.
    • read.csv()—comma-separated values (CSV) files with . as the decimal separator.
    • read.csv2()—semicolon-separated values files with , as the decimal separator.
    • read.delim()—tab-separated values (TSV) files with . as the decimal separator.
    • read.delim2()—tab-separated values (TSV) files with , as the decimal separator.

    In practice, any of these functions can be used to import tabular data with any kind of field and decimal separators: using them for the specified formats of files is only the question of convention and default settings. For example, here is the syntax of the first function: read.table(file, header = FALSE, sep = "", dec = "."). The other functions have the same parameters with different default settings that can always be explicitly overwritten.

    The tidyverse packages readr and readxl provide some other functions for importing specific file formats. Each of those functions can be further fine-tuned by setting various optional parameters.

    readr

    • read_tsv()—tab-separated values (TSV) files.
    • read_fwf()—fixed-width files.
    • read_log()—web log files.
    • read_table(), read_csv(), read_csv2(), and read_delim()—equivalent to the base R functions.

    readxl

    • read_excel()—Excel files.
    • read_csv()—equivalent to the function from the base R functions.

    To dive deeper into data loading in R, you can go through the tutorial on How to Import Data Into R.

  • List and define some basic data structures in R.

    1. Vector—a one-dimensional data structure used for storing values of the same data type.
    2. List—a multi-dimensional data structure used for storing values of any data type and/or other data structures.
    3. Matrix—a two-dimensional data structure used for storing values of the same data type.
    4. Data frame—a two-dimensional data structure used for storing values of any data type, but each column must store values of the same data type.

  • List and define some basic data types in R.

    There are a few data types in R, including: 

    1. Numeric—decimal numbers.
    2. Integer—whole numbers.
    3. Character—a letter, number, or symbol, or any combination of them, enclosed in regular or single quotation marks.
    4. Factor—categories from a predefined set of possible values, often with an intrinsic order.
    5. Logical—the Boolean values TRUE and FALSE, represented under the hood as 1 and 0, respectively.

  • What are some disadvantages of using R?

    • Non-intuitive syntax and hence a steep learning curve, especially for beginners in programming
    • Relatively slow
    • Inefficient memory usage
    • Inconsistent and often hard-to-read documentation of packages
    • Some packages are of low quality or poorly-maintained
    • Potential security concerns due to its open-source nature

  • What is R, and what are its main characteristics?

    R is a programming language and environment widely used for solving data science problems and particularly designed for statistical computing and data visualization. Its main characteristics include:

    • Open source
    • Interpreted (i.e., it supports both functional and object-oriented programming)
    • Highly extensible due to its large collection of data science packages
    • Functional and flexible (users can define their own functions, as well as tune various parameters of existing functions)
    • Compatible with many operating systems
    • Can be easily integrated with other programming languages and frameworks
    • Allows powerful statistical computing
    • Offers a variety of data visualization tools for creating publication-quality charts
    • Equipped with the command-line interface
    • Supported by a strong online community

  • Chi Square Test

    Chi-Square test is a statistical method to determine if two categorical variables have a significant correlation between them. Both those variables should be from same population and they should be categorical like − Yes/No, Male/Female, Red/Green etc.

    For example, we can build a data set with observations on people’s ice-cream buying pattern and try to correlate the gender of a person with the flavor of the ice-cream they prefer. If a correlation is found we can plan for appropriate stock of flavors by knowing the number of gender of people visiting.

    Syntax

    The function used for performing chi-Square test is chisq.test().

    The basic syntax for creating a chi-square test in R is −

    chisq.test(data)

    Following is the description of the parameters used −

    • data is the data in form of a table containing the count value of the variables in the observation.

    Example

    We will take the Cars93 data in the “MASS” library which represents the sales of different models of car in the year 1993.

    library("MASS")
print(str(Cars93))

    When we execute the above code, it produces the following result −

    'data.frame':   93 obs. of  27 variables: 
 $ Manufacturer      : Factor w/ 32 levels "Acura","Audi",..: 1 1 2 2 3 4 4 4 4 5 ... 
 $ Model             : Factor w/ 93 levels "100","190E","240",..: 49 56 9 1 6 24 54 74 73 35 ... 
 $ Type              : Factor w/ 6 levels "Compact","Large",..: 4 3 1 3 3 3 2 2 3 2 ... 
 $ Min.Price         : num  12.9 29.2 25.9 30.8 23.7 14.2 19.9 22.6 26.3 33 ... 
 $ Price             : num  15.9 33.9 29.1 37.7 30 15.7 20.8 23.7 26.3 34.7 ... 
 $ Max.Price         : num  18.8 38.7 32.3 44.6 36.2 17.3 21.7 24.9 26.3 36.3 ... 
 $ MPG.city          : int  25 18 20 19 22 22 19 16 19 16 ... 
 $ MPG.highway       : int  31 25 26 26 30 31 28 25 27 25 ... 
 $ AirBags           : Factor w/ 3 levels "Driver & Passenger",..: 3 1 2 1 2 2 2 2 2 2 ... 
 $ DriveTrain        : Factor w/ 3 levels "4WD","Front",..: 2 2 2 2 3 2 2 3 2 2 ... 
 $ Cylinders         : Factor w/ 6 levels "3","4","5","6",..: 2 4 4 4 2 2 4 4 4 5 ... 
 $ EngineSize        : num  1.8 3.2 2.8 2.8 3.5 2.2 3.8 5.7 3.8 4.9 ... 
 $ Horsepower        : int  140 200 172 172 208 110 170 180 170 200 ... 
 $ RPM               : int  6300 5500 5500 5500 5700 5200 4800 4000 4800 4100 ... 
 $ Rev.per.mile      : int  2890 2335 2280 2535 2545 2565 1570 1320 1690 1510 ... 
 $ Man.trans.avail   : Factor w/ 2 levels "No","Yes": 2 2 2 2 2 1 1 1 1 1 ... 
 $ Fuel.tank.capacity: num  13.2 18 16.9 21.1 21.1 16.4 18 23 18.8 18 ... 
 $ Passengers        : int  5 5 5 6 4 6 6 6 5 6 ... 
 $ Length            : int  177 195 180 193 186 189 200 216 198 206 ... 
 $ Wheelbase         : int  102 115 102 106 109 105 111 116 108 114 ... 
 $ Width             : int  68 71 67 70 69 69 74 78 73 73 ... 
 $ Turn.circle       : int  37 38 37 37 39 41 42 45 41 43 ... 
 $ Rear.seat.room    : num  26.5 30 28 31 27 28 30.5 30.5 26.5 35 ... 
 $ Luggage.room      : int  11 15 14 17 13 16 17 21 14 18 ... 
 $ Weight            : int  2705 3560 3375 3405 3640 2880 3470 4105 3495 3620 ... 
 $ Origin            : Factor w/ 2 levels "USA","non-USA": 2 2 2 2 2 1 1 1 1 1 ... 
 $ Make              : Factor w/ 93 levels "Acura Integra",..: 1 2 4 3 5 6 7 9 8 10 ...

    The above result shows the dataset has many Factor variables which can be considered as categorical variables. For our model we will consider the variables “AirBags” and “Type”. Here we aim to find out any significant correlation between the types of car sold and the type of Air bags it has. If correlation is observed we can estimate which types of cars can sell better with what types of air bags.

    # Load the library.
library("MASS")

# Create a data frame from the main data set.
car.data <- data.frame(Cars93$AirBags, Cars93$Type)

# Create a table with the needed variables.
car.data = table(Cars93$AirBags, Cars93$Type) 
print(car.data)

# Perform the Chi-Square test.
print(chisq.test(car.data))

    When we execute the above code, it produces the following result −

                         Compact Large Midsize Small Sporty Van
  Driver & Passenger       2     4       7     0      3   0
  Driver only              9     7      11     5      8   3
  None                     5     0       4    16      3   6


         Pearson's Chi-squared test
    
data:  car.data
X-squared = 33.001, df = 10, p-value = 0.0002723

Warning message:
In chisq.test(car.data) : Chi-squared approximation may be incorrect

    Explore our latest online courses and learn new skills at your own pace. Enroll and become a certified expert to boost your career.

    Conclusion

    The result shows the p-value of less than 0.05 which indicates a string correlation.

  • Future Directions

    • Advancements in AI and Machine Learning: R is increasingly being used in the fields of machine learning and artificial intelligence, with packages like tensorflow for deep learning and caret for machine learning workflows.
    • Big Data Integration: As big data technologies grow, R is evolving to integrate with systems like Hadoop and Spark through packages such as sparklyr, enabling analysis of large datasets.
    • Web Technologies: The rise of R in web applications through Shiny continues to expand, allowing users to create interactive dashboards and applications that make data accessible to broader audiences.
    • Continued Package Development: The vibrant ecosystem of R packages will likely continue to grow, driven by community contributions and the evolving needs of data science and analytics.

  • Community and Open Source Contributions

    • User Groups and Meetups: R user groups and meetups around the world foster local communities, where users share knowledge, projects, and best practices.
    • Diversity Initiatives: Organizations like R-Ladies promote gender diversity in data science and R programming, providing a supportive network for women and non-binary individuals.
    • Conferences and Events: Events like useR! and RStudio Conference bring together users and developers to share advancements, techniques, and applications of R, fueling innovation within the community.

  • Influence on Data Science

    • Data Science Education: Many educational programs now offer specialized courses in R for data analysis, machine learning, and statistical methods, solidifying its role in academic curricula.
    • Cross-Industry Applications: R is utilized across various sectors, including finance (risk modeling), healthcare (clinical trials), marketing (customer segmentation), and academia (research analysis).
    • Collaboration with Python: The R and Python communities have increasingly collaborated, recognizing each language’s strengths. Many data scientists use both, leveraging R’s statistical prowess alongside Python’s general programming capabilities.