A group is a monoid in which every element has an inverse (necessarily unique).
An abelian group is a group in which moreover the order in which two elements are multiplied is irrelevant.
To some extent, a group “is” a groupoid with a single object, or more precisely a pointed groupoid with a single object.
The delooping of a group $G$ is a groupoid $\mathbf{B} G$ with
$Obj(\mathbf{B}G) = \{\bullet\}$
$Hom_{\mathbf{B}G}(\bullet, \bullet) = G$.
Since for $G, H$ two groups, functors $\mathbf{B}G \to \mathbf{B}H$ are canonically in bijection with group homomorphisms $G \to H$, this gives rise to the following statement:
Let Grpd be the 1-category whose objects are groupoids and whose morphisms are functors (discarding the natural transformations). Let Grp be the category of groups. Then the delooping functor
is a full and faithful functor. In terms of this functor we may regard groups as the full subcategory of groupoids on groupoids with a single object.
It is in this sense that a group really is a groupoid with a single object.
But notice that it is unnatural to think of Grpd as a 1-category. It is really a 2-category, namely the sub-2-category of Cat on groupoids.
And the category of groups is not equivalent to the full sub-2-category of the 2-category of groupoids on one-object groupoids.
The reason is that two functors:
coming from two group homomorphisms $f_1, f_2 : G \to H$ are related by a natural transformation $\eta_h : f_1 \to f_2$ with single component $\eta_h : \bullet \mapsto h \in Mor(\mathbf{B} H)$ for each element $h \in H$ such that the homomorphisms $f_1$ and $f_2$ differ by the inner automorphism $Ad_h : H \to H$
To fix this, look at the category of pointed groupoids with pointed functors? and pointed natural transformations. Between group homomorphisms as above, only identity transformations are pointed, so $Grp$ becomes a full sub-$2$-category of $Grpd_*$ (one that happens to be a $1$-category). (Details may be found in the appendix to Lectures on n-Categories and Cohomology and should probably be added to pointed functor? and maybe also k-tuply monoidal n-category.)
A group object internal to a category $C$ with finite products is an object $G$ together with maps $mult:G\times G\to G$, $id:1\to G$, and $inv:G\to G$ such that various diagrams expressing associativity, unitality, and inverses commute.
Equivalently, it is a functor $C^{op}\to Grp$ whose underlying functor $C^{op} \to Set$ is representable.
For example, a group object in Diff is a Lie group. A group object in Top is a topological group. A group object in Sch/S (the category or relative schemes) is an $S$-group scheme. And a group object in $CAlg^{op}$, where CAlg is the category of commutative algebras, is a (commutative) Hopf algebra.
A group object in Grp is the same thing as an abelian group (see Eckmann-Hilton argument), and a group object in Cat is the same thing as an internal category in Grp, both being equivalent to the notion of crossed module.
Internalizing the notion of group in higher categorical and homotopical contexts yields various generalized notions. For instance
an n-group is a group object internal to n-groupoids
an ∞-group is a group object in an (∞,1)-category.
a loop space is a group object in Top
generally there is a notion of group object in an (infinity,1)-category.
And the notion of loop space object and delooping makes sense (at least) in any (infinity,1)-category.
Notice that the relation between group objects and deloopable objects becomes more subtle as one generalizes this way. For instance not every group object in an (infinity,1)-category is deloopable. But every group object in an (infinity,1)-topos is.
Following the practice of centipede mathematics, we can remove certain properties from the definition of group and see what we get:
Standard examples of finite groups include
group of order 2 $\mathbb{Z}_2$
symmetric group $\Sigma_n$
braid group $Br_n$
Standard examples of non-finite groups include
group of real numbers without 0 $\mathbb{R}\setminus \{0\}$ under multiplication?.
Standard examples of Lie groups include
Standard examples of topological groups include
For more see counterexamples in algebra.
A non-abelian group, all of whose subgroups are normal:
A finitely presented, infinite, simple group
A group that is not the fundamental group of any 3-manifold.
Two finite non-isomorphic groups with the same order profile.
A counterexample to the converse of Lagrange's theorem.
The alternating group? $A_4$ has order $12$ but no subgroup of order $6$.
A finite group in which the product of two commutators is not a commutator.