Being long means you have bought something because you expect its price to rise. In forex, going long EUR/USD means buying euros and selling dollars at the same time.
You profit if the base currency strengthens against the quote currency and lose if it weakens. Each pip of movement is worth a fixed amount depending on your lot size.
Long and the swap
Holding a long position overnight earns or costs swap depending on the interest rate difference between the two currencies, minus the broker's markup. Being long a higher-yielding currency against a lower-yielding one can earn a small daily credit; the reverse usually costs.
Long is not always "bullish on everything"
A long USD/JPY trade is bullish on the dollar but bearish on the yen. Because every currency trade is relative, several long trades can add up to one big bet on a single currency, for example being long EUR/USD, GBP/USD and AUD/USD is three ways of selling the dollar.