加入 Gitee
与超过 1200万 开发者一起发现、参与优秀开源项目,私有仓库也完全免费 :)
免费加入
文件
该仓库未声明开源许可证文件(LICENSE),使用请关注具体项目描述及其代码上游依赖。
克隆/下载
token.cc 2.30 KB
一键复制 编辑 原始数据 按行查看 历史
ASMlover 提交于 2019-05-30 02:09 . :sparkles:feat(loxcc): initial commit
// Copyright (c) 2019 ASMlover. All rights reserved.
//
// Redistribution and use in source and binary forms, with or without
// modification, are permitted provided that the following conditions
// are met:
//
// * Redistributions of source code must retain the above copyright
// notice, this list ofconditions and the following disclaimer.
//
// * Redistributions in binary form must reproduce the above copyright
// notice, this list of conditions and the following disclaimer in
// the documentation and/or other materialsprovided with the
// distribution.
//
// THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
// "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
// LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS
// FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE
// COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT,
// INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING,
// BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
// LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER
// CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT
// LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN
// ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE
// POSSIBILITY OF SUCH DAMAGE.
#include <iomanip>
#include <iostream>
#include <unordered_map>
#include "token.hh"
namespace loxcc {
static constexpr const char* kNames[] = {
#undef TOKDEF
#define TOKDEF(k, s) s,
#include "kinds_def.hh"
nullptr,
};
static const std::unordered_map<str_t, TokenKind> kKeywords = {
#undef KEYWORD
#define KEYWORD(k, s) {s, TokenKind::KW_##k},
#include "kinds_def.hh"
};
str_t get_token_name(TokenKind kind) {
if (kind >= TokenKind::TK_LPAREN && kind < TokenKind::NUM_KINDS)
return kNames[Xt::as_type<int>(kind)];
return nullptr;
}
TokenKind get_keyword_kind(const str_t& kw) {
if (auto kw_iter = kKeywords.find(kw); kw_iter != kKeywords.end())
return kw_iter->second;
return TokenKind::TK_IDENTIFIER;
}
str_t Token::stringify(void) const {
std::stringstream ss;
ss << std::left << std::setw(20) << get_token_name(kind_) << "|"
<< std::right << std::setw(24) << literal_ << "|"
<< std::right << std::setw(04) << lineno_;
return ss.str();
}
}
马建仓 AI 助手
尝试更多
代码解读
代码找茬
代码优化