The paper presents Gupta's relational decomposition technique expanded on linguistic level. It allows to reduce the hardware cost of the fuzzy system or the computing time of the final result, especially when referring to First Aggregation Then Inference (FATI) relational systems or First Inference Then Aggregation (FITA) rule systems. The inference result of the hierarchical system using decomposition technique is more fuzzy than of the classical system. The paper describes a linguistic decomposition technique based on partitioning the knowledge base of the fuzzy inference system. It allows to decrease or even totally remove a redundant fuzziness of the inference result.